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MIP 


The Agricultural 
Model Intercomparison 
and Improvement Project 


Introduction 

The purpose of this handbook is to describe recommended methods for a trans-discipi inary, 
systems-based approach for regional-scaie (locai to nationai scaie) integrated assessment 
of agricuiturai systems under future dimate, bio-physicai and socio-economic conditions. An 
earlier version of this Handbook was deveioped and used by severai AgMiP Regionai 
Research Teams (RRTs) in Sub-Saharan Africa (SSA) and South Asia (SA) (AgMiP 
Handbook version 4.2, www.aqmip.Qrg/ regionai-integrated-assessments-handbook/). In 
contrast to the earlier version, which was written specifically to guide a consistent set of 
integrated assessments across SSA and SA, this version is intended to be more generic 
such that the methods can be applied to any region globally. These assessments are the 
regional manifestation of research activities described by AgMiP in its oniine protocois 
document (availabie at www.agmip.org) . AgMiP Protocols were created to guide climate, 
crop modeling, economic, and information technology components of its projects. 

Various regions of the world are now undertaking regionai assessments following AgMiP 
protocols and integrated assessment procedures. This Handbook version also has a number 
of modifications to the methods and to our description of methods based on what was 
learned from the use and evaluation of the Handbook version 4.2. However, it is important to 
recognize that the procedures presented here were designed for the data available to the 
SSA and SA teams, for implementation of two crop models per integrated assessment 
region (at least DSSAT and APSIM), and for use of one socio-economic model (TOA-MD) in 
the integrated impact assessments. Going forward, we recommend the use of multiple crop 
and economic models when available, based in large part to lessons learned in the various 
crop model intercomparisons (e.g., Asseng et al. 2013; Rosenzweig et al., 2013) and on the 
global economic model intercomparisions (Nelson et ai., 2013). We envision that specific 
choices of multiple models may vary among regions, but that a core set of models should be 
used such that results can be aggregated and compared across all regions. 

AgMiP regional integrated assessments require close coordination among economic, 
climate, crop modeling and IT team members within each regional team. Assessments 
should begin with regionai teams working with stakeholders to define what outcomes are to 
be evaluated and then developing details of the specific production systems that need to be 
quantified. Each regional research team (RRT) should focus on impacts related to, at 
minimum, food production, income, and poverty in their regions; emphasizing important food 
crops and quantifying relevant uncertainties. Where appropriate, livestock components of 
production systems should be included. Then a plan of work should be developed by teams 
that will include AgM IP-recommended methods and procedures to accomplish integrated 
assessments and desired compatibility of outputs across regions. 


This handbook was written such that it represents a minimum approach that can be 
expanded upon in regions where available data and resources allow. The methods and core 
approach used by all interdisciplinary research teams need to be fundamentally consistent in 
order to enable meta-analyses and large-scale studies. Particular care must therefore be 
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taken in intnoduang new methods and modeiis that could potentially limit the ability of results 
to be compared beyond the Immediate region. 

This handbook is a living document that will continue to evolve and be improved through 
input from the regions as they apply it to their own situations and gain experience In the 
methods that are aimed at heiping to unity methods and outputs, 

iCey Attributes of an AgiliP Regional Integrated Asseasment 
“ Designed with Input from stakeholders and policymakers 

- Oriented upon production-syslems-based approach (rather than specific fields) 
potentially Including multiple crops, llvastock, aquaculture, and other sources of income. 

- Transdisdplinary In its linking of climate, biophysical, and socio-economic conditions 
and responses. 

- Flexible in that its framework allows for the testing of adaptations and alternative models 
and methods across a senes of househoids In a given region. 

- Addresses core questions of climate Impact on current and future production systems 
(detailed in the next section) 

- Calibrated on current production system using available observed data with full and 
open documentation. 

- Examines the Impact of both mean climate changes and potential interactions with 

climate variability 

- Presents results In a probabilistic manner with accounting of major uncertainties. 

~ Utilizes consistent terminology across disciplines and among various AgMfP 

assessments and initiatives. 

- Uploads results to an online AgMIP database for archival and cross-raglonal analyses 
with full attribution of data providers and intellectual contributions. 

- Publishes findings in peer-reviewed journals and disseminates information to 

stakeholders. 

Core Clinriate impact Questions 

AgMIP has identified the following core research questions that motivate research adivltles 
for regional integrated assessments (Figure 1): 

1. What Is the sensitivity of cyrrent agricultural productlori systems to dlmate 
change? This question addresses the Isolated impacts of climate changes assuming that 
the production system does not change from Its current state. 

2. What Is the Impact of climate change on future agricultyral production systems? 
This question evaluates the isolated role of climate impacts on the future production system, 
which will differ from the current production system due to development in the agricultural 
sector not directly motivated by climate changes. 

3. What are the jbeoefita of clfinat® change adaptatfoiis? This question analyzes the 
benefit of potential adaptation options in the production system of the future, which may 
offset or capitalize on climate vulnerabilities identified in Core Question 2 above. 
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Vietd 

i < 


Question #3 


> time 

current future 

Figura 1. Overview of core dimate impact questions and the praducUon system states that will be simulated. 
The currant production system is represented hy the blue dot, while the production of the system is represented 
in three ways: assuming that there is no climate change {blacky assuming that there is dinnaie change and no 
adaptation (red), and assuming that there is d I mate change and adaptation (green). The dashed line represents 
the evolution of the production system In response to development In the agricultural sactof that Is not directly 
motivated by climate change. Core Question 2 quantifies the impact of climate change on an adaptation-free 
future affected by climate change, and the green line represents the benefits of adaptation In that future 
production system. Note that Core Question #1 cannot be depl(^ed on this figure, as future climate Impacts will 
necessarily encounter a different production system, however this question provides useful context on current 
biophysical and sodo-economlc vulnerebillty thst motivates Initial Investments In edaptatlon. 



As each question Is designed to allow a comparison between two different production 
system states, Table 1 describes the key dimate, crop, and economic modeling components 
that will describe and compare these states. 


Table 1. Overview of dimate (blue color), crop model (green cdorj, and economic model (gold color) 
components needed In simulation sets required to compare pnoduction system states and answer core questions 
#1 #2. and #3. Note that tiiree crop model oases are defined as green numbers, and for this table the future 
period is assumed to be the RCPS.5 Mid-Century (2040-2069). 


Core Questions 

Simulation Sets 

1, What tsthe sensitivity 
of current agricultural 
production systems to 
climate change? 

Current 

Current CIlrTrate 
Current Production System 

1980-2009 Climate 
C rop/Llve stock Si m uladons 
no Adsptstion (#1) 

TOA without RAP 

Climate Change 
Sensitivitv 

Future Climate 
Current Praduction System 

2040-2069 Cltmate 
Crop/Livestock Simulations, 
no Adaptation E#2) 

TOA without RAP 


1 Ecanomk SimuiationNl 
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Core Questions 

Simulation Sets 

2, What is the impact of 
climate change on future 
agricultural production 
systems? 

Future without Climate 
Chanj!c 
Current Climate 
Current Pradiiction System 
with Trend 

1930-2009 Climate 
Crop/Livestock Simu lati o ns, 
no Adaptation (same as #1} 
TOA with RAP 1 

Future with Climate 
Chanfse 

Future Climate 
Current Production System 
with Trend 

2040-2069 Climate 
Crop/Livestock Simulations, 
no Adaptation (same as #2} 
TOAwith RAP 1 


1 Ecunomlc Simulation 


1 : 


Core Questions 

Simulation Sets 


Future Climate Chanjie 
without Adaptation 
Future Climate 

Future Climate Chango 
with Adaptation 
Future Climate 


Current Pruduction System 
with Trend 

Clim ate-ad a pted Prod uction 
System with Trend 

3. What are the benefits 
of dim ate change 
adaptations? 

2040-2069 Climate 
Crop/Liuestnck Simuletinns, 
no Adaptation (same as #2} 
TOA with RAP 1 

2040-2069 Climate 
Crop/ Livestock SimuEations 
with Adaptations [#3) 
TOA with RAP t 



and Adaptations 


Economic Simulation #3 

^ 


Key Regional Team Outputs 

A number of outputs are anticipated from the sum of RRT activities described in this 
Handbook. This list of anticipated activities is intended to be used for RRT planning, and 
thus specific outputs and methods are provided in the material that follows. In addition, 
however, there are several overarching outputs that should be targeted by each RRT. These 
overarching outputs are summarized below, along with questions that help motivate the 
construction of these outputs, 

a. A nBtwork of sites where muihpie crop models hsve beert osUbts^d using 
tocsily representative management, soUa, cuidvars, and ciimate to stmutate 
food production regions that are important for regional food secutity, with 
analysis of calibration uncertaindes. Key questions include: 

* Which important farm systems, crops, and agricultural sub-regions are to be 
targeted for simulating regional food security? 

* What data are available for calibration of crop models and for economic 
analyses? 

- What are the crops' vulnerabilities to climate vaiiablllty? 

■ What adaptation measures should be analyzed in the study? 
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b. A mt RepmsBittailve AgrlcMaml Pathways (RAPaj for mch mgim for 

am in mmiysm of neglcens/ ol/maf© ImpactM and adaptation. Key questions 
Include: 

« What output variablss from global models and analyses are key drivers of 
agriculture! trends In the region {e.g., climate, commodity prices, population 
growth and GDP growth from Shared Socio-economic Pathways, and global 
representative agricultural pathways)? 

» What key regional variables are likely to be affected by the higher level drivers 
(policy, socioeconomic, and technology)? 

« What quantitative trends in each of the variables are needed to parameterize 
agricultural models (crop, livestock, and economic) for the regional Integrated 
assessment? 

• What qualitative storylines best describe each of these RAPs? 

c. CharactBilmtion of hiatodcai agrthciimate and climate change scenaiim 
dowmcai&d for use at the regional acaie. Key questions include: 

• What are the most important factors that drive climate impacts on a given 
crop/raglon? 

• What types of dimate changes are likely to Impact the region? 

« What are the relative Impacts of climate change and Interannual variability? 

• Where are agro~cllmatlc Impacts likely to be most acute? 

• How certain are projections of future climate change? 

d- Aaaessment of economic impacts for a subset of agricuiturai tegiom under 
future cHmato change, adaptation and socio-economic soeoarfos. Key 
questions include; 

• How will climate change affect the distribution of production, income, and 
poverty in the farm systems of a given region if adaptations do not occur? 

• What are the projected adoption rates of dimate-adapted systems? How will 
various adaptations affect the impacts of climate change? How will alternative 
socio-economic scenarios affect the impacts of climate change? 

• How do uncertainties in key economic parameters affect the projected dimate 
change impacts? 

e. An adaptation package inciuding agronomic, economic, and poilcy 

adaptations that Improve oc/fcomes under future conditions. Key questions 
include: 

• What farm-level management adaptations would be beneficial under future 
dImate conditions? 

» What changes to the production system would increase resilience to future 
dimata challenges? 

» How can these adaptations foe represented consistently In crop and economic 
models? 

1 Documentation for communication to the aciantiflc community and to 
s^kehoid&fs. This indudes web sites, databases, scientific publications, and 
reports that have been communicated to stakeholders. 
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AgMIP Standardized Formats and Tools 

To ensure consistency in the archivai and transiation of data and resuits from AgMiP 
integrated assessment regions, severai standardized data formats have been created that 
wiii be referenced in the activities beiow. These standardized formats aiso ensure 
compatibiiity with stand-aione and web-based tools that will facilitate the execution of 
research activities and the dissemination of integrated assessment results. 

- AgMiP climate data format - Standardized format for climate series at a single 
location, featuring daily climate data and variables needed for crop modeling. 

Guide for Running AgMiP Climate Scenario Generation Tools with R - This “AgMiP 
Climate Scenarios Guidebook” describes how to access the data and suite of scripts 
required to produce AgMiP climate scenarios using the AgMiP methodologies, using 
.AgMIP-fbrmatted climate data for both Inputs and outputs. 

- AgMiP Crop Experiment (ACE) database - contains site-based crop experiment or 
farm survey data using a harmonized format based on JavaScript Object Notation 
(JSON). The data objects are described as key-value pairs with flexible and extensible 
data descriptors based on the ICASA data standards. Data can be translated from raw 
format to ACE and from ACE to crop model-ready formats using the QuadUl desktop 
utility. These data should be archived in the ACE online database through the AgMiP 
Data Interchange (data.agmip.org). 

- Data Overlay for Multi-model Export (DOME) - contains datasets for field overiays, or 
data which were not measured at the ACE sites, but are needed for crop modeling 
exercises. These data are estimated based on the best agronomic knowledge of cultural 
practices in the region. Seasonal Strategy DOME datasets contain baseline and future 
management and climate inputs which are used to modify existing site data for analysis 
of hypothetical scenarios. Each DOME dataset will be linked to one or more ACE 
datasets. These data should be archived in the DOME online database through the 
AgMiP Data Interchange (data.agmip.org). 

- AgMiP Crop Model Output (ACMO) - Harmonized format for results of the crop model 
simulations. ACMO data are linked to both ACE and DOME data. These data should be 
archived in the ACMO online database through the AgMiP Data Interchange 
(data.agmip.org). 

- Cultivar library - This conceptual database consists of a library of cultivar parameters 
used for various models. The parameter sets will be stored as JSON objects, files, or 
links to other sources. Cultivar datasets will also be linked to ACE, DOME and ACMO 
databases to ensure repeatability of simulations. (Not currently implemented.) 

- Economic model Input and output archives - This repository will store input and 
output data for the TOA model, in the form of Excel files. Each file will be associated 
with one or more ACMO datasets. 

- DevRAP - Provides a structure to guide the process to develop Representative 
Agricultural Pathways (RAPs), to record and document the information systematically, 
and to translate RAPs into model-specific scenarios. We have designed a version called 
DevRAP v1 .0 to provide a structured format for the parameters needed to run the TOA- 
MD model as well as crop models. 

- AgMiP ftp site - A temporary ftp site has been established to archive data while the 
interfaces for other databases are prepared. This ftp site can be accessed at 
ftp://data.aqmip.org using the usernames and passwords assigned to each team. 
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- Data Journal - will be used to publish and permanently archive dataeetB which are 
complete and form the basis of journal articles, web visualizations, or other references. 
These published datasets will be assigned a DOI and can be dted with credit given to 
data authors, as in ar\y other published work. 


Guidelines for Activities for AgMIP Regional Research Teams 

A list of charaderistjc activitjes for AgMIP Regional Projects includes eleven categories of 
activities along with methods that integrate across climate, crop modeling, economic, and IT 
teams. These are presented below. Figure 2 shows a schematic of the overall components 
of the Integrated assessment process. Because of the Importance of dose collaboration 
among different disdpllnes (dImate, crop, economic and livestock If Included In the 
systems), regional teams may want to define a subset of the overall analysis to make sure 
that all team members learn how to beet Interact with other team members to achieve the 
overall results. For this reason, a set of ‘Fast Track” steps and procedures Is suggested 
when new regional teams are first learning how to effectively use these methods (Appendix 
1). Here, we present the overall activities needed to perfomn the entire Integrated 
assessment. 



FIgura 2. AgMIP l^lonal I A Framaworlc: Paralel daveloprnaiit of systam dasigri, data and modeling to couple 

crop a livmtDck models with TOArMD. 

1. Scoping of production systems and developing/kefining research work plan fbr 
regional Integrated assessment The overall outputs from this set of activities Is a 
report describing the region, crops selected tor explicit modeling, characteristics of the 
broader agricultural systems, the availability of data (dlmate, crop, soil, and 
socioeconomic), and stakeholder Interactions and Inputs. Suggested components of this 
phase of the projects are as follows. 

a. Review key profect objectives, develop or reflne research questions, 
detemnlne relevant stakeholders and policymakers, and assign team roles. 


9 














Handbook of Climate Change and Agroecosystems Downloaded from www.worldscientific.com 
by NASA GODDARD SPACE FLIGHT CENTER LIBRARY on 04/14/15. For personal use only. 


Appendix 1 


343 


b. Define key production systems to be studied and how they influence food 
security in the region. Select crops and livestock that will be explicitly modeled in 
the study, other important components of the production system, and important 
sub regions that will be modeled in the study (Figure 3). 


System Diagram 



Figure 3. Example diagram describing the major elements and interactions of a production system. 

c. Select (multiple) crop models that will be used, keeping in mind that the aim 
is to use at least the DSSAT and APSIM cropping system models across all 
regions. Assess the level of experience among team members with the selected 
models and identify additional capacity building needs. 

d. Become familiar with the Tradeoff Anaiysis Muiti-Dimensionai impact 
Assessment Modei (TOA-MD), the economic model that has been used in prior 
regional efforts, or equivalent regional economic model(s). identify project team 
members who will work with the regional economic model. Evaluate regional 
economic model capacity-building needs and team members in the RRTs who 
would participate in this training. 

e. Produce a work pian that includes responsibie persons, activities, time 
iines, and maps of regions showing administrative boundaries, regions that will 
be studied, and points showing where climate and crop data are available. The 
report will include specifics of the information obtained in the above points, 
including the plan tor stakeholder engagement. 


2. Develop Representative Agricultural Pathways (RAPs) for use In regional analysis 
of climate impact and adaptation. RAPs provide an overall namative description of a 
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plausible future development pathway, and also contain key variables with qualitative 
storylines and quantitative trends, consistent with higher-level pathways (e.g. SSPs, global 
RAPs developed by the AgMlP Global Modeling Group), see Box 1, Box 2, and Figure 4. 
Prices, policy and productivity trends should be consistent with the higher-level F?APs or 
scenarios that are available (SSPs, global RAPs, CCAFS regional scenarios), RAPs are 
translated into one or more scenarios (parameterizations) for the TOA-MD model and crop 
models. These scenarios represent a set of technology and management adaptations to 
climate change. These scenarios, developed for specific RAPs, will typically include changes 
in the types of crops or livestock produced and the way they are managed (e.g., use of 
fertilizers and improved crop cultivars). 

Procedures for RAPs development should be based on the step-wise process as shown in 
Box 1, with input from all components (climate, crop, economic) of the AgMlP Regional 
Team. Outside experts may need to be consulted if there is an important area of expertise 
not represented within the team. Stakeholders should also be incorporated into RAPs 
developed, as described below. 


Box 1. Overview of Step-wise Process for RAPs Development 

1 . A multi-dlsdplinary team of scientists and otiier experts is established. 

■ Team members need to have knowledge of the agn cultural systems and regions to be covered 

2. The team reviews general goals and define the time period for analysis and selected higher-level 
pathways (Shared Sode-econemic Pathways, Global RAPs) to follow the nested approach (Figure 4) 

3. Main drivers from higher level pathways are identified (and Quantified if possible, e.g. outputs from 
global models) 

4. Based on drivers and specific agricultural systems, a draft of a title and a short narrative of a RAP is 
constructed 

5. Based on the draft namative, the team Identifies key parameters that will likely be affected by driving 
forces 

6. The team draft storylines for each one of the parameters {see Figure 5 ) 

7. The team checks for consistency within the RAP components and with higher level pathways and 
models' outputs 

3. Based on consistency check, agreement arid confidence levels among team participants, steps 4 -7 
are repeated until an acceptable draft of consistent storylines and levels of agreement and confidence 
are achieved. 

9. The team Identifies parameters that will need additional revision (expert opinion, modeled data, etc.) or 
that will likely be subject to sensitivity analysis. 

10. The team elaborate full RAP narrative 

11. The RAP narrative is documented and distributed to other experts, sdentists and key stakeholders for 
comments. 

12. The final RAPs are distributed to the modeling teams for parameters quantification and scenario 
development 
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FIguPB 4. Developing RAPs and Scenarios: Use of a nested approach to assure consistency 


REPRESENTATTVT; agricultural PATmVAYS DEVTLOPYIENT TOOL 

DevRAPs bet-3 t<ersK>n 


/iejficaA ircaficB 
Timf Aorirtro.- 


&irbatftAP.- 1 


Othrr higher-level 
Sceaarie.- ■ 


CAUVERY DELTA. INDIA 


SAP Title.- Higher expectatiorrs (or rice production facing constraints 
PAPSX- 2.1.1. 

PAP hlAfmATli^.- 

Government and state policies aim to invest in non-agr activities, leading to migration 
out of agriculture with the consequence of shortage of labor and reducing household 
size. Govt promotes improved rice cultivar use but policy to reduce fertilizer subsidy 
continues. Bio-physical conditions and low fertilizer use lead to small benefit from 
improved cultivars. 



















CATEGORY 

VARIABLE f 
INDICATOR 

Direction of 
change 

Magnitude 
of change 

Rationale for direction 
and magnitude of 
change 

Percent 

change 

Rationale for 
percent change 

Agreement? 

Confidence? 

Bio-Physical* 

Soil 

degradation 
(loss of 
nutrier^s due 
to leaching) 

Increase 

Medium 

Flooding causes nutrients to 
leach out, but frequency of 
flooding events increasing 


Based on previous 

Medium 

Medium 




























InsitutionallPolicy* 

Input subsidies 
(fertilizer) 

Decrease 

Small 

government policy is to 
reduce subsidies but also 
wants to offset productivity 
loss due to climate change 


Government sets a 
goal to reduce 
subsidies at slow 

Medium 

Medium 


13 <^1 


Figure 5. Screenshot of ttie DevRAP tool v1 .0 
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a. Building the RAP and qynntitativ© trmncis. In this section wa outline the 

steps to bond RAPs narratives for AgMiP*s regional teams. RRTs should use the 
DevRAP too! (See Fig y re S) to develop and document RAPs (Valdivia and Antle 
2012 ). 

1 ) identify members of the RAPs deveiopmeni team. Key members of the research 
team representing climate, crops ^ livestock, and economics. Outside members may 
be solicited if additional expertise is needed. 

2} Define time period for enafysis: AgMIP has designated four '‘time slices” In the 21®^ 
Century for analysis, current, early-century (2D06“2039), mid-century (2040-2069) 
and late-Century (2070-2099). 

Select higher-level pathways: Following the concept of a nested approach, relevant 
narratives and quantitative information from selected higher level pathways (e.g. 
SSPs, Global RAPs) need to be extracted. AgMIP regional teams are recommended 
to begin using SSP2 (see Box 2 tor a summary description). 

4} RAPs research process; 

a. First meeting: 

I. Start with a “Businsss as usual" (BAU) RAP 

II. Team members identify key parameters that will likely be affected by 
higher level pathways and draft RAP narrative 

ill. Team members are assigned variables for research 
Iv. Team members conduct research “Use of templates for reporting and 
supporting documentation. These templates can be distributed to 
experts for feedback 

b. Second meeting: 

i. Team members report findings and discuss storylines for each 
variable 

if. BAU RAP Is finalized using the DevRAP tool and complete the 
following information: 

1 . Complete information for each parameter: 

2. Direction, magnitude Bn rate of change 

3. Narrative logic for changes 

4. Check for internal consistence and with higher-level pathways 
and models' variables 

5. Level of agreement among participants 

6. Level of confidence among participants 

7. if level of agreement and/or confidence are low, repeat 
process until acceptable levels are achieved, 

8. Assess whether one or more parameters need to be revised 
by other experts or selected for sensitivity analysis. 

9. Document source of information (pathway, model, literature, 
expert). 

Hi. Additional RAPs are IdentlHed 

iv. Process similar to BAU is carried out widi additiona! background 
msBsroh 

a Meetmg(s) to create additional RAPs -Follow similar steps as In a and b 
d RAPs dlstnbuted to stakeholders and outside experts 
5) Modelers develop Scenarios (see section below) 


13 



Handbook of Climate Change and Agroecosystems Downloaded from www.worldscientific.com 
by NASA GODDARD SPACE FLIGHT CENTER LIBRARY on 04/14/15. For personal use only. 


Appendix 1 


347 


Box 2. Shared Soclooconomlo Pathway #2 (S5P2) Symmaryi Middle of the Road 

In this world, trends ty penal of recerit decades continue, with some piogress towards achieving development 
goals, reductions in resource and energy Intensity at historic rates, and slowly decreasing fossil fuel 
dependency. Development of low-tncome counties proceeds unevenly, with some countries making 
relatively good progress while others are left behind. Most economies are politically stable with partially 
functioning and gbbaliy connected markets. A limited number of comparatively weak global institutions e?;ist. 
Per-capita income levels grow at a medium pace on the global average, with slowly converging income levels 
between developing and industrialized countries. Intna-regional income distributions improve slightly with 
increasing national income, but disparities remain high in some regions. Educational investments are not high 
enough to rapidly slow population growth, particularly in low-income countries. Achievement of the 
Millennium Development Goals is delayed by several decades, leaving populations without access to safe 
water, improved sanlbtlon, and medical care. Similarly, there is only intermediate success in addressing air 
poliutjon or improving energy access for the poor as well as other factors that reduce vulnerability to climate 
and other global changes. 

Source: O Neill et al. (2012). 


b. Quantifying Economic Model Parameters, RAP narratives are next used to 
construct parameter sets for crop and livestock models and for economic models, 
including TOA-MD. Here we discuss creating parameters for TOA-MID using the 
DevRAP tool’ research teams can create other parameter sheets for other models they 
may be using. The sheet SCEN_STi (where i=strata 1,2,..) in the OevRAP tool is 
designed to create and document scenarios for the TOA-MD model. One or more 
scenarios can be constructed for each RAP as follows: 

6) Create name and short rjarjraf/ve to describe the scenario'. It is important to document 
the key characteristics of the scenario, thus the narrative and scenario name must 
contain elements to understand what the scenario is about. 

7) identify modei parameters: The DevRAP tool includes the list of parameters used in 
the TOA-MD (see Figure 3). The team will identify the parameters that will be 
quantified for the specific scenario. 

8) Quantify each parameter, use RAP information to assign a value to each parameter. 
Data for these parameters can be obtained fmm the literature, modeled or from 
expert judgment, and these need to be documented. 

c. Quantifying Crop Model Management and Teclinology Inputs for Scenarios. 
Similar to steps 6-8 above, the team will use the SCEN_CROPSM sheet in the 
DevRAP tool to quantify specific crop model parameters (fertilizer level, sowing 
density, improved cultivars, etc.) based on RAP narratives and scenario details (e.g., 
adaptation packages). 

3. Assemble existing data from experiments and calibrate crop models. The target 
outputs from this set of activities are high quality data that are entered into the AgM IP ACE 
database and used for calibration of multiple crop models for selected sites. The data and 
model simulations will provide scientific evidence that the models are adapted to the crops 
and environmental conditions in the region and have cultivar characteristics/parameters that 
can be used to simulate the crops that are to be studied in the region. This is what is 
typically done in crop modeling training programs and in research projects. It is likely that the 
RRTs already have accomplished this for some subset of crops and crop models to be used 
in the studies. This activity is intended to document those data and past efforts, bring 
together new data, and ensure that the models to be used have gone through this phase of 
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work. It is anticipated that there will be relatively few site-years with data for any of the 
selected crops, but those data will be made available in the ACE database and used to 
improve the adaptation of crop modeis for the regions. Suggested components of this 
activity are as foilows. 

a. Assemble data from past experiments for calibration of selected crop 
models to the region for selected crops. This includes crop, soil, and climate data for 
site-specific experiments and fieid trials in the region. This will require input from 
crop modelers, climate, and IT project team members. 

b. Input data Into sentinel site ACE database for use in multiple crop models. 

c. Using the AgMIP IT tools, create input files for each crop model. 

d. Using methods provided by each crop modeling group (e.g., DSSAT, APSIM, 
perhaps others), simulate the sentinel site experiments and estimate cultivar- 
specific parameters to best simulate the experimental results. These results will help 
set cultivar characteristics and perhaps soil conditions for regional simulations to be 
carried out by the teams (see below). 

e. Secondary focus wlii be estimation of productivity parameters, relative to 
initial conditions, crop residue, soil organic matter pools, and soil fertility for the site- 
specific sentinel data (NOTE: these steps will be repeated to be more appropriate 
for the regional simulations where site-specific information is not available). 

g. Document model simulations (inputs, management, outputs, soil, climate, cultivar 
coefficients) by placing them in the ACE database, along with explanatory text 
and appropriate tables and figures showing the quality of the calibration of 
cultivar coefTicients. 

4. Assemble and quality^ontrol current climate series. The key products from this 
activity will be a high-quality version of in-situ climate observations in .AgMIP format for each 
location where crop models will be used, a file documenting the changes made to the 
original raw observations, and summary maps and statistics characterizing the region being 
analyzed. The following methods are recommended: 

a. Assemble and assess quality of station observations. 

* Identify weather stations that best represent selected crop modeling regions. 

* Obtain as much of the 1980-2010 period as possible (Daily precipitation, 
maximum and minimum temperatures, solar radiation or sunshine duration, 
wind speed, dew point temperature, vapor pressure, and relative humidity). 

* Convert to .AgMIP units and format with missing data given a vaiue of -99. The 
AgMIP format is described In the AgMIP protocols available at 
http://www.agmip.org . 

* Name the climate series site with a 4-character code (first 2 characters from 
internet country code and second 2 characters representing location) following 
the guideiines in the AgMIP protocols (e.g. “NLHA” for Haanveg, Netherlands). 
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• Begin a text file to document changes made in the quality assessment and 
quality control of the raw files (e.g., “NLHAJnfb"). 

• Identify outlying (+/- 3 standard deviations probably deserves a closer look) and 
questionable data that may be corrupted. The best approach remains plotting 
out the dataset elements as time series to see if anything looks amiss. 

• Check to see if data are plausible physically (e.g., questionable value 
supported by other variables), temporally (e.g., questionable value supported 
by preceding or following values), or spatially (e.g., questionable value 
supported by neighboring stations). If values are not plausible, replace with a 
value of -99. 

• If vapor pressure, dewpoint temperature, or relative humidity correspond to a 
time of day other than mid-aftemoon (^maximum temperature), approximate 
values at the time of day of maximum temperature will be computed, by 
conserving more robust dewpoint temperature or vapor pressures (which can 
be calculated using temperature at time of measurement) and then 
recalculating relative humidity using maximum temperature. 

b. Obtain background daily climate time series (1980-2010) from the AgMERRA 
dataset provided by the AgMIP Climate Team (Ruane et al., in preparation). The 
output of this activity will be a complete set of estimated daily climate data for use in 
filling in missing data for observation stations. (If the observational dataset is fully 
complete this step may not be necessary). Until the AgMERRA dataset is fully 
accessible online, latitude and longitude coordinates for each location to be 
simulated may be sent to Alex Ruane (aiexander.c.ruane@nasa.gov) to obtain this 
dataset in the .AgMIP format. 

c. Fill In missing/flagged observation data using station observations and the 
AgMERRA estimated climate series. Note that two overlapping observational sets 
may be combined in a similar manner. This set of activities will provide a continuous, 
complete, physically-consistent daily climate series from 1960-2010 in .AgMIP format 
for use with the crop models. Suggested steps are: 

• Go through station observations and fill in all data gaps as follows. 

• Use simple interpolations for short data gaps (e.g., if 3 or less days are missing 
fill in by interpolating from good values on either side). Use caution if strong 
outlier exists on either side as this may not be an effective approach (e.g., if 
strong rain event precedes data gap we can’t assume that it will have persisted 
throughout gap. 

• For moderate gaps (e.g., 4-10 days) use background dataset to fill in gaps and 
bias-correct using surrounding good data (adjust mean to ensure approximate 
continuity with beginning and end points). 

• For longer gaps use background datasets to fill in gaps and bias-correct using 
climatological biases calculated by comparing background dataset to good 
station observations (e.g., if July Tmax in background dataset is typically 0.6’C 
too warm, subtract 0.6"C from background dataset when filling in a July data 
gap; if observed rainfall is typically only 90% of background rainfall in October, 
multiply background dataset by 0.9 to fill in October gaps). 

• Ensure that filled in data are physically plausible by checking the following: 
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o Relative humidity does not exceed 100% 
o Relative humidity, vapor pressure, and dewpoint temperature are 
physically consistent at time of day of maximum temperature, 
o Solar radiation Is not greater than astronomical maximum (can use 
historical monthly maximum as proxy) or beiow zero, 
o Maximum temperature Is at least 0.1 above minimum temperature. 

d. ApproKfimate offmate time series in regions for integrated assessments. This 
set of activities produces a set of climate time series that corresponds to each crop 
or livestock modeling location in an Integrated assessment region and forms the 
198Q“2Q09 (current) climate series Identified In Table 1. (Note that this procedure Is 
automated In the AgMIP Climate Scenarios Guidebook using the “farmdlmate” 
routine). Working with the crop and economic modeling teams, recommended 
methods include: 

« Obtain desired latitudes and longitudes for each integrated assessment site to 
be modeled. Name each station with a 4-character code. 

* Identify as many weather stations in (or nearby) region as possible. Quality 
control these datasets following methods above, then assign each of the 
integrated assessment locations to the most representative weather station 
(‘'corresponding station" may not always be selected by geographic distance 
alone, but may also factor In climatic zones and/or elevation). 

* if there are additional precipitation gauges (where other variables are not 
observed), determine which integrated assessment locations correspond to 
these and start with this precipitation record. 

« Estimate differences In monthly dlmatoiogles between Integrated assessment 
locations and corresponding station location using AgMERRA dataset (rf 
distances are greater than ~50km) or WorldClim dataset {if distances are less 
than ^50km). Adjust corresponding station In a manner similar to the gap-fllilng 
bias adjustment to estimate integrated assessment climate series. 

0 . Create an AgMIP Agro-cffmatio Atlas for Current Period Climate. This atlas 
will cx)ntain maps of important agro-dimatic variables for the region. Recommended 
methods include: 

* Generate regional maps of mean temperature and precipitation during historical 
baseline period from observational data and from GCMs to be used in scenario 
generation. 

« Identify agriculturally important dlimate metrics. If region is affected by a 
prominent monsoon, determine which monsoon metrics are Important to 
regional agriculturB. Compare climate information with planting rules of thumb 
from farmers and/or crop model configurations if possible. 

* Calculate these metrics and produce maps using observational products during 
the historical baseline period (in consultation with local experts and 
stakeholders). 

* Analyze uncertainty among observational products (if available) as reference 
for future uncertainties. 
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5. Assemble data and simulate crop models for analysis of yield variations. The major 
outputs of this series of activities inciude simulations of yields by multiple crop models for 
multiple sites within the study region. Ideally, regional projects will use on-farm survey data 
for which the crop models can be used to simulate each field that was surveyed. This will 
provide simulated results for the “matched'* case where the models use climate, soil, and 
management for each field to simulate productivity that is then “matched” with observed 
yields for each field. In order to simulate each field, the teams will need to make 
assumptions about crop model inputs that are needed but not collected in the farm surveys. 
These assumed inputs should be developed with advice from agronomists in the region, and 
they will be documented along with the observed field survey data for each simulated result. 

Crop modeling team members should analyze these matched results to be sure that they 
were correctly produced with well-defined and documented inputs and to be sure that results 
are reasonable. Invariably, there will be biases between simulated and observed survey 
data, and the modelers should analyze means, variances, biases, and other characteristics 
of the results prior to confirming that they are ready for use in the economic analyses. 

A summary spreadsheet file (ACMO) will be prepared by the crop modeling team for use by 
the economists. This file will document all of the inputs and assumptions used in the model 
simulations as well as provide a summary of crop productivity outputs (e.g., yield). 

If farm survey data are not available, crop modelers should work with multiple years of 
historical yield statistics at a district level. In this “unmatehed” case, simulated yields cannot 
be matched one-to-one with observed farm field survey data, and variations in climate, soils, 
and management inputs across the region will need to be defined and sampled from. This 
should be done in a representative manner based on available information and expert 
opinion, particularly about variations in management practices across farms within the 
district. In this case, comparisons of crop model results will be aggregated to a district level 
for comparing with district yields and analyzed. Also, a report should be written on methods 
and results of crop model calibration, aggregation methods, uncertainty associated with 
seasons, and biases relative to regional aggregated yields. 

Recommended steps include: 

a. Matched Case. Assemble matched yield case data from household farm survey 
from sub-regions, where crop yield and minimal management (sowing date, 
fertilization, etc.) are available along with household economics information for 
50 to 200 farmers. If it is not possible to simulate each field to produce matched 
outputs, crop modelers will need to use procedures for unmatched results (see 
5.C. below and Appendix 2). 

• Follow the more detailed instructions in Appendix 2. You will need to 
enter yield survey data Into Matched_Survey_Data.lmport.xlsx 
spreadsheets and download AgMIP Tools from the http://tools.agmip.org/ 
website. 

• Work with regional Agronomists and Soil Scientists to identify the most 
likely soils for each field in the survey, and create the Field_Overiay 
spreadsheets that fill in the information missing from the survey, such as 
initial soil water, initial nitrate and ammonium, soil organic carbon 
degradation, fertilization dates, prior crop residue, etc. Work with Climate 
colleagues to identify climate information/sites. 

• Use the QuadUl tool software to convert these spreadsheets into model- 
ready input files for multiple crop models. 

• Use crop cultivar coefficients that have been calibrated with independent 
sentinel site data in the region (from procedure # 3 above). 
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» Simulate the matched case survey data, cx)mpyte means and standard 
deviation of observed and simulated. Analyze simulated results by 
computing various statistics and compare with observed statistics, 
including comparison of yield distributions, means, variances, and 
characteristics of bias between observed and simulated yields and 
outliers. Depending on these analyses, crop modelers may decide to 
accept these Inputs as baseline soils and management conditions for 
further analyses or they may need to make changes In the assumptions in 
conjunction with agronomists familiar with production in the region. 
Standard output files (ACMO) are used to provide crop model inputs and 
outputs for use by economists. See Appendix 2 for advice on analyzing 
cumulate probability distributions. 

b. Sim y late Yields for Household Survey Farms. Using each crop model, 
simulate crop outputs accounting for the distribution of climate, soils, cuitivars, and 
management present in the region for use in the economic model analyses. Crop 
modelers will create ACMO files that Include metadata for all “production* Inputs 
used to simulate the fields and a summary of yield results for each field. Methods 
include: 

* A distribution of production environments and management will be determined 
based on the field surveys (or on unmatched distributions of Inputs, see 5.d). 
Each RRT will determine the best source of information for creating these 
multiple withln-region environments and management systems to best 
represent the inherent variability that exists In the region. This Is an Important 
decision that needs to be made by crop, climate, and economic team members 
working together. 

* Model simulations will be conducted over the distribution of weather stations, 
soils information, sowing dates, cuitivars, residue return, soil organic matter 
pools, and fertilization that represents the region being predicted. Prepare data 
file that contains all of the Information used to produce the simulations and on 
key outputs such as crop yield for use by the economic team (ACMO file). 

* Crop modeling teams should analyze results and write appropriate reports and 
publications documenting and Interpreting the biophysical Implications of 
climate change and RAP-based adaptation options that are included in the 
analyses. 

* Document model simulations (Inputs, management, outputs, soil, climate, 
cultlvar coefficients) by placing them in the ACE database, along with 
explanatory text and appropriate tables and figures showing the yield 
probability distributions (using probability of axcaedanca), analyses of 
residuals. 

« Create maps and summary statistics e.g., spatial distribution of dimate, soils, 
management, and yields illustrated in GIS mapping methods 

g Unmatciied Survey and Simulation Fields (or Regional Historic Yleldsl. If 
there are no yield data available from household surveys, it will not be possible to 
simulate a yield for each farm as in the matched data case. In this case, crop 
modelers will need to work with economist team members end agronomists In the 
region to assemble information on variations in managemant and soils in the region 
for this “unmatched* case. Assemble soil, typical management, and typical cultlvar 
information for the region along with long-term crop statistics data (for district level 
or higher) for use in evaluating crop model abilities to simulate regional yields and 
production. Methods for doing this are: 

* Yield statistics of crops will be collected for the region over historical time 
periods of 30 years. 
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* Cultivar life cycle information will be assumed correct from the site-specific 
sentinel site data. 

« Survey information will be collected with input of agronomists and soil 
scientists, to represent the distribution of weather stations, soils information, 
sowing dates, cuitivars, residue return, soil orgianic matter pools, and 
fertlilzatlon that represents the region being predicted. 

« Use QuadUf software tool (as above) to create model-ready input Hies for 
multiple crop models to simulate historic observed years as well as future 
climate and adaptation-RAPs scenarios. 

* Similar to the matched case (5.b), crop modelers will create ACMO files for use 
by economists and prepare reports and publications that describe and Interpret 
biophysical results of the study. 

« For purposes of evaluating crop model abilities for simuiating regiona! or 
district-ievei yields, crop model teams should aggregate yearly simulated 
results (over climate sites, soils, sowing dates, cultivars, management) to the 
district level yield for comparison with historical district yields (e.g., comparing 
distributions of simulated and observed yields, mean annua! bias, etc.). 

* Document model simulations (inputs, management, outputs, soil, climate, 
cultivar coefficients) by placing them in the ACE database, along with 
explanatory text and appropriate tables and figures showing the yield 
distributions, analyses of interannua! and spatial variations. 

* Create maps and summary statistics e.g., spatial distribution of climate, soils, 
management, and yields illustrated In GIS mapping methods 

i. Assemble economic data for regional economic analysis and develop skills for 
using the regional economic model. Outputs from this set of activities include at least 
two economist members per project team that are capable of performing economic 
analyses In their respective regions and data assembled on baseline socioeconomic and 
agricultural production data in their regions. An output will be crop modelers and 
economists with experience in Interdisciplinary collaboration In co-developing data sets 
for use by both teams (e.g,, historical yields and socioeconomic survey data), with the 
data input to the AgMlP database. Another output is the TOA-MD model set up to 
simulate economic outcomes for the region, using baseline socioeconomic data. Specific 
steps include: 

a. identtly economic survey data and correeponcifng study componmnim (see 
the TOA-IID rnodel and! suppoftlng documents for further details). 

h. Work with the climate and crop model teams to produce and analyze baseline 
crop simulations for sites that are jointly selected for the region, based on available 
data from regional statistics and/or on-farm surveys. This step requires direct 
cooperation among disciplinary team members and relies on the above steps on 
mllscting climate series and calibration of crop models for regional yields. 

c. Estimate aoonomfc mode! parameters using the available data (sea the TOA- 
ilD model and supporting dooymsnts for details). 

d. Prepare e report (following AgMlP template) describing the existing systems and 
documenting the data used for regional economic analysis and perametar estimates. 


7. Create dewnecsled climate scenarlcs, based on AgMlP protocols, for use in the 
assessments of climate change studies, and provide future scenarios for use with crop 
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modsis in the AgMIP database. Note that these procedures are captured in scripts contained 
In the AgMIP Guidebook for Climate Scenarios. A key output from this set of activities wiil 
be future climate scenarios derived from the latest iPCC dimate models and downscaled for 
use In the target regions. These scenarios will be In the .AgMIP dimate data format and 
ready for multiple crop model simulations of Impacts and agricuiturBl adaptation for each 
region. In addition, a dImate atlas will be produced of Important dimate verlabies and 
derived agriculturaily-important Indices. These atlases will include maps for use in scientific 
publications and for communication of results to stakeholders. 

a. Create CM IPS delta-basedl climate scenarios. These scenarios will be based on 
historical baseline daily climate data, with each day’s weathar variables perturbed 
using the changes in dimata modal outputs for futura time periods varsus those 
same model outputs for the historical time period. These scenarios are made using 
the “agmipsimpiedeita" routines in the AgMIP Guidebook for Climate Scenarios, and 
will be created for each crop modeling site for the 5 GCMs emphasized for the core 
climate Impact questions and for all 20 CM1P5 GCMs for the best-calibrated site In 
the region, Spedfic methods indude; 

* For each of these sites, calculate monthly changes in corresponding mean 
maximum temperature, minimum temperature, and precipitation by comparing 
future 30-year dimate periods (AgMIP defines three main time periods: '‘near- 
tefm""201 0-2039; ‘‘mid»century*"2040-2069; and "end-of-century*»2070-2099) 
to the baseline climate period (1980-2009; use RCP 4.5 for 2006-2009 period) 
from the same GCM. The Mid-Century RCP8.5 is the priority period for 
assessment. 

• Impose these monthly changes on baseline dImate series for ail selected sites 

by adding temperature changes to the baseline record and multiplying by a 
precipitation change foctor. 

♦ Assume that solar radiation, winds, and relative humidity are fixed at the same 
values that were In the historical time series. Ensure that vapor pressure, 
dewpoint temperatures, and relative humidity are physically consistent at time 
of maximum daily temperatures (warmer temperatures have higher vapor 
pressures and dewpoint temperature at same relative humidity). 

• This will result In a 30-year .AgM IP-formatted climate series for a given future 
period and GCM. Scenarios should be constructed for all 20 CM IPS climate 
models at the best-calibrated site In the region, while scenarios for the other 
crop modeling sites (form survey sites) are only required for the 5 GCMs 
(CCSM4, GFDL-ESM2M, HadGEM2-ES, MIROC5, and MPI-ESM-MR) in focus 
for the com climate impact questions (identified as the 2040-2069 (future) 
dImate serias in Table 1 . 

ib. Create AgMIP Agroollmatle Atlas that shows future climate change 
scenarios with ynccrtalntfes using maps with probabfiitlss. These maps and 
summary results will be published and also csommunicated to stakeholders. Specific 
methods are: 

* Produce region-wide maps of CMIP5 climate change projections, including 
median changes in mean quantities, variability, and extremes (along with 
corresponding uncertainties) for temperatures and precipitation. 
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« Also produce maps for agncyitu rally Important climate metrics under future 
climate conditions for comparing with those produced for historicai baseline 
climates. 

• Place growing season temperature and precipitation changes from the 5 core 
question GCMs in the context of the wider CMIP5 ensemble {e.g., with scatter 
plots or monthly box-and-whisker diagrams). 

c. Create CillFi mean and variability change scenarios. This activity will prod oca 
.AgM IP-formatted oil mats scenarios Including both monthly and sub-monthly 
changes In temperature and precipitation. These procedures are captured in the 
"agmipsimpie_mandv” scripts in the AgMIP Guidebook for Climate Scenarios. In 
many mglons there are not sufficient resources or available regional climate model 
(ROM) results to capture important uncertainty in climate projections, however where 
these are available they are particularly helpful for their representation of sub- 
seasonal metrics that are often affected by smailer-scale atmospheric dynamics. 
Suggested methods include: 

« Calculate monthly changes in mean maximum temperature, minimum 

temperature, and precipitation by comparing future 30-year climate periods to 
the current climate period from the same GCM/RCM combination (where 
available). 

• Calculate monthly changes in the standard deviation of maximum temperature, 
the standard deviation of minimum temperature, and the number of rainy days 
(predpitation>0.1 mm) by comparing future 30-year climate periods to the 
current climate period from the same GCM/RCM combination (where 
avaliable). The shape parameter of the gamma distribution for wet events may 
also be of interest from ROM results, but is generally not of sufficient quality in 
GCM simulations. 

« impose these monthly changes on baseline climate series for all sites used In 
the analyses using a stretched distribution approach that adjusts each event by 
comparing existing and desired values by distributional percentiles. 

• Assume that solar radiation, winds, and relative humidity dally variables from 
the historical daily climate records are unchanged. Ensure that vapor pressure, 
dewpoint temperatures, and relative humidity are physically consistent at time 
of maximum daily temperatufBS. 

• Produce mean and variability change scenarios for all 20 CM IPS GCMs at the 
best-calibrated site in each region. 

d. Create Neir4@mn oflmate scenarios (optional). This activity will produce 

.AgM IP-formatted climate scenarios for the Near-term (2010-2039) period, where the 
influanca of climate variability is likely to be at least as large as that of climate 
change. Methodologies and tools for this procedure are based upon Greene at el. 
(201 2a, b). While these methods are still under development, we outline them here: 

• Obtain long-term temperature and precipitation records from at least 1960-2010 
(e.g., from CRU, GPCC, and University of Delaware sets) and CMIP5 GCM 
outputs over the 1980-2039 period. 

» Calculate GCM-ensemble growing season precipitation and maximum and 
minimum temperaturBS to represent anthropogenic influence on region. 
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* Smooth obsen/ations for each location using 30-year smoothing window 
representing long-term trend and variability. 

» Subtract average of smoothed observations and GCM trend from annua! series 
of growing season observations at each location to obtain time series of natural 
variability (may add weight to 30-year smoothed observations if circulation 
anomalies or thresholds are known to have responded to anthropogenic 
forcing), 

» Transform the natural variability time series into principal components. 

» Use top 5-10 Empirical Orthogonal Functions (EOFs) to fit vector aoto- 
regresslve model, and use this model to create 10,000 years of natural 
varlabinty for each site. 

» Select from the distribution of decadal rainfall totals in this record and from the 
distribution of CMIP5 GCM trends in order to create a 30-year Near-term 
scenario designed to examine particular vulnerabilities in the agricultural sector. 

* Construct a dally time series in .AgMIP format that matches the seasonal 
properties in the Near-term scenario using analog months from the AgMERRA 
daily climate series used in Activity 4 above. 

i. Candy et multiple crap/llvestack model slmulatlans at all crop/Hvestock modeling 
locations for the three cases identified In Table 1 : #1) current climate with current production 
systems technology, #2) future climate scenaiio{a) with current production technology (no 
adaptation), and #3) future climate scenario(s) with adaptation, in addition, examine full 
GCM ensemble for a single, best-calibrated and representative site in each Integrated 
assessment region (these latter results will not be passed on to economic analysis). 

Outputs should be reviewed by crop modeling team members working closely with economic 
and climate team members to ensure the results are plausible, e.g., that there are no 
unexplained outliers. When the team has finalized the crop model simulations and 
summarized outputs in the ACMO file, outputs fmm the three cases will be used by the 
economists In the TOA-MD economic model, and outputs from the single location GCM 
ensemble simulations will be used by the climate team members to place the subset of 
GCMs in context. 

a. Sinnyfate yield distribution across alt farms for the core climate impact qjyastion 
cases. This Includes simulation of responses across GCMs, farms, and across years 
within tha 30-year periods. Multiple crop/llvestock models will be used to simulate 
variations In climate, soils, and management, thus obtaining within-region variability of 
production. These results will be put into the AgMIP ACMO database for use in the 
economic analyses. 

« Case #f : Curmnt climate with current pruduatlon systems technology'. Simulate 
current period climate series (identified as planting years 19S0-2009 in Table 1} 
for all farms using the 30-year climate series created in Activity 4 above, current 
production systems and a CO 2 concentration of 360ppm for ell years (see 
Table 2). 

» Case #2; Future dImate scenario(s) with current producilon technology (no 
adaptation): Simulate future period climate delta-based dImate scenarios 
(beginning with RCP8.6 Mid-Century, identified as planting year^ 2040-2089 in 
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Table 1) for all farms using the 30-year climate series cmated in Activity 7 
above, currant production systems and a CO 2 concentration corraspondlng to 
the central year for all simulations (see Table 2). Run scenarios for at least the 
following GCMs: CCSM4, GFDL-ESM2M, HadGEM2-ES, MIROC5, and MPL 
ESM“MR. This GCM subset was selected to save resources due to their long 
history of development and evaluation, a prefeinence tor higher resolution, and 
established performance In monsoon regions. 

» Organize simulated yields and enter those results Into the AgMIP Crop Model 
Output database (ACMO), which contains variables needed by the economic 
team members for the regional economic model analyses. 

« Create and document an adaptation package via collaboration between the 
crop and economic modeling team. Adaptations connected to vulnerabilities 
identified In a comparison between Case #1 and Case #2 results are preferred 
(e.g., heat or drought-tolerant cultivars; dramatically shifted sowing dates; 
added Irrigation; subsidies tor Improved seed). Improved management that Is 
not directly linked with climate impacts on the region are better handled as part 
of the representative agricultural pathway that defines future production 
systems prior to climate change adaptations. 

» Case #3: Futum climate ao&na!iQ(s} with currant production tachnoiogy with 
adaptation: Simulate future period climate delta-based climate scenarios 
(beginning with RCP8.5 Mid-Century, Identified as planting years 2040-2069 in 
Table 1) for ail farms using the 30-year climate series created in Activity 7 
above, current production systems plus the adaptation package identified 
above in Activity 8a and a CO 2 concentration corresponding to the central year 
for all simulations (see Table 2). Run scenarios for at least the following 
GCMs: CCSM4. GFDL-ESM2M, HadGEM2~ES, M1ROC5, and MPl-ESM-MR. 

• Summarize yield impacts in tables, graphs, and maps for publication and 
communication to stakeholders. Included In these tables, graphs, and maps 
should be: 

o with! n-reg Ion variability In impacts, and 
o uncertainties associated with crop models and climate models 
o Interpret reasons tor variations among crop and climate models and 
households 

Table 2: Central year carbon dioxide concentratlona for AgMIP climate scenarios and lima periods, with the 
Current and RCP8.5 Mid-Century time periods highlighted as they will be the primary fo4Sij3 of integrated 
assessmarYt. These are the concentrations to be used for ai! years in a given scenario experiment. 


Scenario and Time 
Period 

Planting Year 
Coverage 

^Id-year 

[C02] 

Cufmnt 

1980-2009 

19% 

3i0 ppm 

RCP4.6 Near-term 

2010-2039 

2025 

423 ppm 

RCP8.5 Near-term 

2010-2039 

2025 

432 ppm 

RCP4.6 Mid-Century 

2040-2069 

2055 

499 ppm 

RCPS.i Mld-Cerityry 

2040-20S9 

2055 

571 ppm 

RCP4.6 End-of-Century 

2070-2099 

2085 

532 ppm 

RCP8.6 End-of-Cantury 

2070-2099 

2085 

801 ppm 
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b. Sfmyfgit® innpiicrtii of foil ©niiombl® of cfimite olharig@s from all 10 ClifPi 
GCMs on ainglo, best-caliliratod mitm in lotogratedi assossmont mg ion. 

CompafB dimat© impacts from all 20 GCMs using both delta-based (mean changes 
only) and msan-and-varlability scenarios, place tha 5 GCM-subset in this broader 
context, and estimate influence of variability changes. If these simulations suggest 
that variability changes are substantially important, these scenarios may be used 
instead of the delta-based scenarios for core question economic analysis If resources 
aliow. 

c. Simyfate fmpac;^ fronri Near^erm oiimate scariarloa (optional). Conduct 
simulations for planting years 2010-2039 at the best-calibrated end most 
representative site using the Near-term climate scenarios created In Activity 7 above. 


i. Anatyie regional economlo Impacts of climate change without and with adaptation 
using the regional economic model. Outputs will be Impacts of climate change on 
agricultural production, farm income and poverty, and projected rates of adoption of adapted 
systems. To the extent possible, teams should use these results of these sub-national 
analyses to draw implications for the national impacts, e.g., by extrapolating impacts to 
regions with similar production systems. The AgMIP regional integrated assessment 
framework Is summarized In Figure 1. 

a. Economist team members will use the methods outlined in Appendix 2 to use 
crop modal simulated yields to estimate regional economic model parameters. 

b. The economist team members will use the TOA-MO (or similar) regional 
economic model to analyze the impacts of climate change for each of the 
economic model simulations identified In Table 1 , using crop/livestock model 
cases #1-#3, which together address the three core climate impact questions: 

* 1 . What is tha sensitivity of current aghcuiturai pmduc^on systems to 
climate change? 

* 2, What is the impact of dimate change on future agricuituraf production 
systems? 

* 3. What are the benefits of climate change adaptations? For this analysis 
the economists will first work with the crop modeling team to Identify an 
adaptation package that includes crop/Hvestock and economic model 
parameters representing adaptations designed to address climate 
vulnerabilities and opportunities identified in questions 1 end 2 above, 

c. These nesuits will be summarized with graphs and rsports for scientific 
publications and for dissemination to stakeholders. 


10. Archive data and analyses of reayfte for Integrated aasesamenta 

An Impoftant output of Integrated assessments will be databases for the regions that will 
include dlmate, soil, management, experiments, surveys, regional economic model 
parameters, and historica! yields that will have been used for the analyses In this set of 
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projects that win be highly valuable for additional futurB analyses as models Improve, 
research and policy questions change, and adaptation appraaches evolve. These archived 
data Will ba available for broad use, although It is recognized that some data used in the 
projects (such as dally climate data In some cases, or confidential survey data) may not be 
archived due to intellectual property rights and data policies. Additionally, archived results 
from climate, crop models, and economic models will serve as the source for various 
publications and presentations, Including wab-basad Information that will be made available 
for stakeholders. A well-documented archive of AgMIP experiments, outputs, and analysis 
tools will facilitate future Improvements In capabilities to perform Integrated assessments of 
climate change Impacts and adaptation at site and aggregated scales. 

Figure 4 presents a data flow diagram for AgMIP Regional Integrated Assessments. Data 
created using the tools and procedures outlined in this document should be archived in 
AgMIP databases. Research teams shall contribute data to ACE {AgMIP Crop Experiment), 
DOME (Data Overlay for Multi-model Export), ACMO (4^MiP Crop Model Output) and 
Regiorial Eoonomic databases. The AgMIP IT Team will provide tools and training through 
the regional workshops and web tutorials so that RRTs can interact with the ACE, DOME , 
ACMO and regional economic databases directly through the AgMIP Data Interchange 
(data.agmip.org) which connects to AgMIP data nodes. This will allow for storage of 
standardized databases of crop experiments and yield trials for the region and outputs of 
crop model simulations. 

Data to ba archived Includes: 

a. Climate data 

• Observed weather data for crop model calibration 

• 1980-2Q1Q qualily-controllad daily climate data for use in the AgMIP regional 
assessment 

• future ensembles of dally climate scenarios 

b. Crop Modeling 

• Harmonized (ACE and DOME) data associated with detailed calibration data 
from field experiments or other sources. 

• Calibrated cultivar parameters 

• Soil parameters as modified by modelers used In simulations 

• Harmonized data associated with farm survey sites for regional assessments 
using baseline and future conditions {ACE and DOME data) 

• Crop model outputs for survey, baseline and various future climate conditions 
(ACMO data) 

• Text summary of climate impacts on yield, considering crop management in 
survey fieids 

a Economic data 

« Inputs to regional economic models (including survey metadata) 

« DevRAP matrix spreadsheet Including output data from global aconomlo 
models used in the RAPS and productivity trends - csv fbmnat 

» Regional economic mode! outputs - Impacts of climate change on agricultural 
production, farm Income and poverly, and percentage of winners and losers 
and predicted adoption rates of adapted technologies in spreadsheet format. 

A desktop utility is under development that will cx^mblne all of the steps required for a 
regional assessment researcher to input and manipulate farm survey data and convert to 
ACE format, create field overlay and seasonal strategy DOMEs, generate model-ready data 
for the user’s models of choica, harmonize simulated model outputs Into ACMO format, and 
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store all data to the server in linked ACE, DOME and ACMO databases. Users will also be 
able to use the utility to query the databases for existing datasets. The utility is a 
combination of the spreadsheet template data entry, ADA, QuadUl and ACMOUl with 
additional linkages to the online databases. 


Raw Data 


Research Activities 


Data Products 



Figure 4. Data flow diagram for AgMIP Regional Integrated Assessments showing AgMIP 
data products and archive databases 


11. Disseminate integrated assessment resuits. The key outputs from this set of activities 
include scientific publications, project reports, results summarized on regional web pages 
linked to the AgMIP web site, and workshops with stakeholders. Initial and ongoing 
interaction with stakeholder and policymaking communities are iikeiy to be as valuable as 
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the dissemination of results to these communities, as early and consistent Interactions 
increase boy-in and help develop a more useful and efficient research project 

a. Develop IRiRT»specfflc web pages for the AgiifP web site. The AgMfP IT Team 
will provide information on how to create region-specrfic web pages and wili give 
regional IT team members access to create and maintain that web information. Each 
region will have Its project goals and methods on the site as well as pictures of 
project activities, output tables, maps, and graphs, as well as news items, for 
example. 

b. Condyi?t projei:^ workalhop with stakeholders. 

• Invite stakeholders to SSA and SA workshops 

* Organize stakeholder sessions at a region-spedfic workshops to keep them 
informed and learn from them what information they need for their planning and 
policy-making responsibilities 

c. Prepare scientific publlcatlcms. AgMiP research Is designed to provide results 
that are well-suited for peer-reviewed journal publications and informing national and 
regional publications related to climate vulnerabilities, economic development and 
adaptation/mltigation planning relative to food production and food security. 
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Appendix 1 

“Fast Track” Proof of Concept Integrated Assessment Exercise 

Because of the coordination needed among different science disciplines in the AgMIP 
regional integrated assessment efforts, each AgMIP regional team should perform a “proof 
of concepf assessment on a fast track to help everyone on the regional teams to 
understand their roles and the interactions that must take place among different disciplines. 
Accomplishing this will ensure that the mechanics of the process are understood and 
functioning, at which point it wiil be easier for all teams to proceed with their further, more 
detailed assessments. 

To do the fast track integrated assessment exercise, the team should select only one 
subregion, one crop, one crop model, and one climate site location; then simulate crop 
yields using the historical climate data for that one location and also simulate crop yields for 
one climate change scenario for the time period of 2040 ~~ 2069 using the methods 
described above. Additional details are: 

a. The entire regional team should identify one small sub~region where the fast track 
assessment will be performed. Ideally, the sub-reglon should be an area in which 
household survey data are available with at least one climate data site within the 
area and where there are experimental data available In or nearby the area that can 
be used for calibrating one (or more) crop models. 

b. The crop modelers will parameterize the crop models using available data from 
experiments, If this has not already been done. This will provide parameters for 
cultivar types that are currently being used in the region. 

c. The economists should describe the site characteristics, including a map showing the 
farms and including management and farm characteristics. 

d. Economists wiil provide the socioeconomic data, including i^rm site locations, to the 
crop modelers so that they can assemble the needed crop model Inputs to mn the 
crop models. Ideally, the socioeconomic survey data would have data on crop 
management practices (planting date, N application amounts) and on crop yield. For 
example, there may have been 80 farms surveyed with such data, and those l^rms 
wouid be used to assemble crop model input data for each farm, similar to the 
Machakos example that was used to damonstrata the approach. 

e. The climate team members In the region will prepare and dean the historical dimate 
series for one station in the region. This site will act as the baseline dimate series for 
all crop modeling and analysis In the fast-track (including sumounding farms), and will 
also serve as the basis of one climate change scenario generated using the basic 
delta method that represents projected GCM changes. These climate series may be 
used in the crop model runs to compute the Impacts of dimate change (assuming no 
adaptation for this fast track). 

f. The regional crop modelers will prepare input files for running one selected crop 
model {DSSAT or APSIM preferably) for each farm location in the selected study 
slt@/area. This includes assembling representative soils for the sitss. The crop 
modelers will simulate each of the fields in the farm surveys, analyze simulated 
results relative to observed yields to evaluate reliability of results, and prepare a 
model output fils ACMO) for documenting model Inputs and outputs for use by 
economists in the TOA-MD analyses. 

g. If socioeconomic data do not Include farm site yields, then the crop modeling team 
members will us© the procedures for calibrating end evaluating crop models for use 
In simulating mean yields for district or other administrative unit (see section 5c in 
this handbook). This alternate procedure will provide crop models ready for use In 
the region with estimates of average bias. 
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h. The crop modelers will then simuSate yields for each of the farm sites in the selected 
area uslrig historical climate data (1 980-2009 planting years) and repeat the 
simulations using the one selected dimata scenario's dimata file. The modelers will 
assess yield results, evalyeting how reasonable they are and produce an AgMIP 
Crop M^el Output file (ACMO) that will be used by the economists in the TOA-MD 
analysis. 

L The economic team members will take crop modal results and osa the TOA-MD 
model to analyze the impacts of the dimate change scenario on the distribution of 
economic Impacts for the area. 

]. The entire team will meet to evaluate the entire process and to discuss and Interpret 
the results. 

k. After the proof of concept study, the team will be ready to design its assessments of 
Impacts and adaptation options based on the RAPs, more advanced climate 
scenarios, and a better representation of dimate and crop model uncertainties. 


Table 1- Regiana! Resaarch Team AdlvItJas. This Is a chacldist of activitias that should bs coordinatad across 
team members In each RRT such that each RRT can produce comparabis Integrated assessments, as noted In 

ths timeline of adivities. 


Task 

1 . Scoping of cropping systems and developing/refining research work plan 

2. Develop Representative Adaptation Pathways (RAPs) for climate change 

3. Assemble Existing Data from Experiments and Calibrate Crop Models 

4. Assemble and Quality Control Historical Baseline Climate Series. 

5, Assemble Data and Simulata Crop Models for Analysis of Yield Variations. 

B. Assemble Sodoeconomlo Data; Develop Skills for Regional Economic Analyses 

7. Create Downscaled Climate Scenarios 

8. Simulate Productivity Impacts of Climate Change; Analyze Adaptation Options 

9. Analyze Economic impacts of Climate Change and Adaptation Approaches 

10. Archive Data and Analyses Results for Integrated Assessments 

1 1 . Disseminate Integrated Assessment Results 
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Appendix 2 

Caleyfating Statistics for Cllimata Impact Assessments Using TSme-AveragecI 
Crop/Lsveslock tyfodef Simyfaltcms, RAFs and TOA»liD Model 

John An^B and Roberto VaidMa 

February, 2014 


Introduction 

This document descnbas how crop modal simulations and Representative Agricultural 
Pathways can be used with TOA-MD to implement assessments of climate change impact 
and adaptation using “matched" and “unmatched" data from crop or livestock simulation 
models. We use the case of a population of heterogeneous farms with a single stratum and 
one production activity to Illustrate the methods. This appendix presents methods for the use 
of date from crop or livestock models to simulate climate impacts by averaging data over 
time within the “current period" and within the ‘Tuture period" defined for the analysis. 

It is important to recognize that the methods presented here are not designed to represent 
temporal variability within the current period or within the future period. We focus on the time 
averaged case because of key limitations of the data that are usually available. In most 
cases, we do not observe yields or management over enough year^ to measure variation 
overtime for Individual farms. Thus, our methodology Is designed to use cross-sectional 
survey data to estimate spatial heterogeneity reflecting bio-physical differences and 
management differences across farms. 

The first section presents concepts and definitions. The second section describes the 
calculations used to estimate the parameters of the TOA-MD model. 

1. Coricepls, Oeflnitions and Assuinptlons 

Thm Thr@@ Com Questions 

The methods described here can be used to answer the three “core questions" described in 
the first pert of this Handbook: climate sensitivity analysis In current world conditions 
(question 1); impact of climate change in future world conditions (question 2}; adaptation to 
climate change in future world conditions (question 3). Note that the TOA-MD model can 
also be used to analyze the adoption of adapted technologies under current conditions, but 
that type of analysis is not part of the Gore Questions for climate change analysis. 

InGorpomirng Spatial and Tmmparal Varimbsisty 

We know yields and related outcomes {economic returns) vary over space and time, and this 
variation is important to understand vulnerability of farms to climate change. Therefore we 
need to project these distributions into the future for climate Impact assessment 

We can describe a variable such as a yield for a production system h used at location j at 
time t as yhjt. Let phj be the mean for farm j obtained by averaging its values of Ym 
and let pht be the mean for year t obtained by averaging yhjt over ell farms in that year. We 
will say that Ph] is the time-averaged mean for farm j and Pht is the spatialfy-avefaged mean 
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for year 1 SimiSariy, we can decompose the variance of yhjt into spatial end temporal 
components. To obtain meaningful approximations to the distribution of outcome variables 
for the TOA-MD modal, wa oten need to stratify populations of farms that coma from 
different sub»populations or different time periods. For example, In a given year, we may 
need to stratify farms geographically or by socio-economic characteristics such as size or 
ownership of livestock- 

Our goal is to use tha available data to estimate these variances using the data we have: 

• Farm survey data that provide observations of current yields, management and other 
variables. 

« Secondary data on average yields for the study region. 

« Projected yield growth rates from global agrlculturei economic models or RAPs. 

« Current and future simulated yields that are based on observed soils and 
management, and current and future projected weather. 

A key limitation of the data is that, in most cases, we do not observe yields or management 
over enough years to measure variation over time for individual farms. Thus, our 
methodology Is designed to use our cross-sectional survey data to estlmata spatial 
heterogeneity reflecting bio-physical differences and management differences across farms. 

Defining the Study Region, Time Periods and Systems 

The presentation hare is for tha analysis of a farm population In an Integrated assessment 
region,” i.e., a study area defined geographically and possibly in terms of other socio- 
economic characteristics. Our convention for time t Is that It represents a calendar year. The 

current period covers t " 1 T years, and the future period Is F years ahead of year 1 , and 

thus covers years t - F+1,...,F+T. Following the TOA-MD terminology, we use a subscript h 
= 1,2 to index the farm system which is composed of the household and the agricultural 
production system which can Include crop, livestock and aquaculture sub-systems. 

Note that the Interpretation of system 1 and system 2 depends on the type of analysts 
being dorie. For the purpose of cafcu fating the effects of climate change on 
prodyctlvlty, we Interpret system 1 as the current production system In the current 
period and system 2 m the same system If It were observed In use with the future 
cfimate. However, for analysis of the three questions, system 1 and system 2 are 
constructed to represent various combinations of climate change effects, socio-economic 
conditions and technologies. 

To further simplify this presentation, wa consider the case of a production system that has a 
single activity (say, a crop). More generally, the same fypes of calculations would be applied 
to each activity in each sub-system (i.e., to all crops, ail livestock, all aquaculture activities). 

In most cases available farm survey data will come from a year (or years) near the end of 
the current period used for climate data and bio-physIcal model simulations, and 
management data used in these simulations will come from these survey data. For example, 
AgMiP's Regional Research Teams are using 19B0-2009 as the current period for climate 
data and crop and livestock simulations. However, most survey data being used are from 
2005 or later. For the economic analysis, using a 30-year period as “currenf is not practical 
due to data limitations, the challenges of dealing with real and nominal trends, etc. 
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Therafor®, for the economic analysis, we are using the most recent 5-year period cantered 
as closely as possible on the year(s) of the economic survey data for purposes of defining 
the “current period.” 

Basic VmatiB Deflmtmm 

t = time (caiendar year) 

F = beginning of future time period (year) 

T = length of current time period G and future time period F (years, first year = 1) 
h = system Index = 1,2 

j = farm index, j = 1 farms in data sample representing the integrated assessment 
region study area 

k = year when survey data were collected 

ph = representative output price (currency units/kg) in the current or future period 
Vhit = crop yield (kg/ha) 

Mij = time-averaged mean of yields yijt for farm j for the current period 

= time-averaged mean of yields y^jt for farm j with climate change 

Yik = mean of observed yields yijk in the survey data for current year k 

Yi = mean of yields averaged over all years in the current period, obtained from secondary 
data in the study area 

^ = Yi/Yik = normalization factor used to scale survey data yields to the current period 
mean 

Shjt - simulated crop yield for system h, farm j In year t (kg/ha) 

sij ” simulated crop yield for farm J time-averaged over the current period 

S2| = time-averaged simulated crop yield with climate change for farm j 

= Sh|t/yhit= bias In simulated crop yield (note, can only be observed for current period) 
fj = S 2 j/Si| = relative yield for farm j 
ai^ = total crop area on the farm (ha) 

Rihit “ revenue - pht * yhjt* (currency unIts/farm/time) 

Ri^. = time-averaged revenue (currency units/farm) 

Chjt = production cost (currency units/farm/tlme) 

Khjt " Chjt/ahjt YhfL ~ average production cost (currency units/kg) 
mhjt == (Ph “ K:hjt)/Ph = profit margin (%) 

Ch| " time-averaged production cost (currency units/farm) 
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Ci = mean of produdlon cost averaged over b\\ years In the current period, obtained from 
secondary data in the study area (if availabSe) 

Pck ” Ci/Cik ” normalization factor used to scale production cost survey data to the current 
period mean (note, If can’t be estimated, then use pdt = Pykto assume that production 
costs from survey data deviates from what is representative for the current period and costs 
are normalized by the same factor as yields; or use pck - 1 when cost data is representative 
for the current period). 

Ghjt " Chji/Rt 3 |t = production cost relative to revenue (unit-free) 

Ghj = Cf^Rhj - time-averaged production cost relative to time-averaged revenue (unit-free) 
Vh|t ” Ghjt " crop net returns for the farm (currency unlts/tlme) 

Vh| = average of Vhjt over current or future time (currency units) 


ThB RBiBtim mid ModBi 

We use both survey data and simulated data to represent the affects of dimata change on 
productivity using the fBi&tivo yield modeL The idea behind this model is as follows: suppose 
we interpret system 2 as the current system being used under conditions of a future climate, 
and we interpret system 1 as the current system being used under conditions of the current 
climate. The average yield under climate change can then be related to the mean of the 
current system as « fj- We define rj as the relative yield under climate change. We 
assume that we can approximate a yield impacted by climate change by estimating r| with 
crop model simulations as s^j/sij, where Is the time-averaged simulated yield for farm j 
under climate change, and Sij is the time-averaged simulated yield for farm j in the current 
period. Then we project the yield with climate change as y 2 jt= fj * yijk where yijk Is the 
observed yield from a farm survey In the current year k for farm j. 

Matched and Un-Matehed Data 

Two situations may ba encountered with analysis using this type of farm survey data: 

Matched Data: a crop yield can be simulated for each survey farm, for each crop in the 
system for which a crop model Is available. This Is true when weather and sol! data can be 
associated with each survey farm, and some crop management data are included in the 
survey. 

Data matching is possible in most cases where f^rm survey data are available and some 
kind of information Is included In the survey to identify the survey farms’ locations. Ideally, 
the spatial Identifier is the farm’s spatial coordinates (or even better, the centroids of 
individual fields). Note that when spatial coordinates are not included in a survey, they can 
be approximated with other location identifiers. For example, a legal address or village name 
may be available, and this may be used to approximate the spatial coordinates of the farm. 

it is important to note that the matching of weather and soil data to survey farms will typically 
require using the best approximatlQn posslbie given evailabie data, because farm-spadflc 
weather and soils data are almost never available. Nevertheless, as long as weather and 
mil data can be assigned to each survey fanm tlircygh some reasonable procedure, 
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the term “matched data” Is used, because with the farm specific management data, it is 
possible to simulate yields for each farm. 

Un-MatchBd Data: a distinct crop yield cannot be simulated for each survey farm; however, 
spatially varying weather and soil data are available to run crop model simulations with 
representative management for the region. 

Note that in the un-matched case, it is possible to estimate a simulated yield distribution that 
corresponds to the population of farms represented by the survey; however, it is not possible 
to match simulated yields to the survey farms. 

RAPs: Accounting for Future World Conditions 

RAPs are used to represent future conditions, including productivity trends and effects of 
future economic conditions on output prices and costs of production. Regional RAPs must 
incorporate trends (e.g. yield trends from global econ models) following the methodology 
presented below, to translate current production systems into the future conditions defined 
by a RAP. 

Parameters needed for Question 2 

The following parameters are used to adjust for future trends, if appropriate. They can 
derived from modei projects or RAPs as appropriate. 

r = compounded yield growth factor between current and future periods. Used to estimate 
trended parameters of system 1 for Core Question 2 (e.g. use AgMIP Reference scenario 
data from IMPACT global modei). 

<|>h = compounded price growth factor between current and future periods. Used to estimate 
trended output price parameters. 

• When h=1 , + Is the price growth factor WITH NO climate change and it is used to 
estimate parameters for system 1 for Core Question 2 (e.g. use AgMIP Reference 
scenario data from IMPACT global model). 

• When h=2, <|> is the price growth factor WITH climate change and it is used to 
estimate parameters for system 2 for Core Question 2 (e.g. use 
SSP2_HGEM_DSSAT_5crop scenario from IMPACT global Model) 

W = compounded variable production cost growth factor between current and future 
periods. Used to estimate trended parameters of system 1 for Core Question 2. This factor 
should be defined as part of the RAPs. 

Parameters for Core Question 3 

Note that System 2 for Question 2 is the same as System 1 for Question 3. For System 2 of 
Question 3, we begin with System 1 and modily the parameters to represent the adapted 
technology (including changes in yields and costs). Thus, for System 2 of Question 3, when 
calculating the relative yield the numerator should be obtained from the crop or livestock 
model simulations for the adapted technology. For components of the system that do not 
have crop or livestock models, estimates of the productivity effects of the adaptation must be 
obtained from other information such as the RAP or other research in the literature. 
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Kmy AsBumpHom 

A1 : The dMdbuthn of (the true tlme-avemged mean of^rm j In the current pemd) is 
approximated by the distibudon of yijk In the current year kin which the spatial yield 
distnbutlon is observed. This assumption aSlows us to use the observed yield In year k, 
normalized to the mean of the current pariod, as a proxy for pij. However, since we know 
that the obsen/ed yields for each farm will vary from the average In the current period, we 
know that the projected future yields Include this variation. Thus, we need to take care In 
using data from the current period. The more years of data that can be used, the mono we 
can average out the Individual-year variation from the current period data, and doing so 
should result in better estimates of pij and thus better projections of future yields. 

A2: Crop slmuladon biases are the sama in the present and future, implying they are 
iocadon-spBdfic but time invariant La., = bj for a// /. Since we cannot observe future 
biases, there Is no way to relax (or invalidate) this assumption (although, we could test Its 
validity with historical data). Note Sh|t bj yt^ thus A2 implies that we can use reiativa 
simulated yields to approximate relative actual yields because S 2 jt/Sij = bj y 2 jt/bj pij = yVMii 
r 2 jt. The same logic follows for the time-averaged relative yield rj. 

A3: Gf^ = 65 ^= The ratio of cost/revenue is the same in systems 1 and 2 for all years. 
Note, this is equivalent to the assumption that average cost per unit of output, KhjtJs a 
constant across farms and time that is proportional to output price; i.e. C^it = ichjt * yhjt*®hjt, Khjt 

” Khfbr all j and t, and Ki/pi = Ka/pa. Equivalently, this is the assumption that the profit margin 
mhjt Is the same In the present and the future. This assumption provides a standardized way 
to project future cost based on current costs, but note that this assumption can be modified 
to fit a future situation where costs are expected to deviate from this relationship. For 
example, if labor costs are a large share of cost of production and are expected to increase 
faster than output price, the analyst might assume that tci/pi < X2/P2 or that the profit margin 
Is lower in the future. 

A 4 : Yields In the Integrated assessment region grow at rate y, and crop model simulations 
for the future petiod do not IncQfporate factors accounting for this growth between the 
current and Mura periods. In the approach presented hare, we assume that there is an 
independent yield growth factor associated with technological change that is not accounted 
for In crop model simulations. However, if all technological change is accounted for in the 
crop model simulation methodology, then the growth factor r should be set equal to 1 . 

A5: Area allocated to the cmp is constant within the current and within the Mum time period 
(but not necessarily the same between the two periods). This assumption is based on the 
premise that data on area variation over time are not available within the current period, and 
are not modeled for the future period; alternatively, the analyst can use year-spedfic data if 
such information is available. 

2. Calcy fating TOA-liO If^odel Parameter 

Matched Beta 

Step MAI: Calculate the relative yields q for each l^rm j = in the survey. 
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Step MA2: Survey data provide observations of yijk. Caicuiate system 1 variabies for each 
farm in the survey data for the current period as: 


Mij = Pyk ■ yijk * r 
Rij = <|> 1 * Pi ‘ aij ‘ Mijf 
Gij = 3ck ’ ^ ’ Cij/Rij, 
Vij = Rij-Pck*4J*Cij 


Note that F = 1 , = 1, 4^ = 1 for Core Question 1 

Note: pi is a representative price, adjusted to the current period average as necessary. / 3 * is 
the normalization factor used to adjust observed yields in the data to the current period 
population average. The current period is defined as the five-year period centered as closely 
as possible on the year(s) of the economic survey data. Minor crops and livestock are not 
normaiized. 

Step MA3: caicuiate system 2 variabies for each farm in the survey data for the future 
period: 


M?) = rj ■ Mu 

Rzj = c|>2 ‘ Pz ‘ a2j ‘ M2j 

Czj = Gij ' Rq 

V20 = Raj - Qy = (1 - Gij) • R;y 

Note that <^2 = 1 for Question 1 

Step MA4: Using the data from MA2 and MAS, caicuiate the means for Rij, Cij, R 2 J and C 2 J, 
and the standard deviations of Vij and V 2 J 1 where the caicuiations for the future period made 
over aii farms and future growing seasons. 

Step MAS: Caicuiate RH012 as the correiation between Vij and V 21 . 

Note: RH012 may be over-estimated using these procedures due to the under-estimation of 
future yield variation by crop or iivestock models. Therefore the upper bound on RH012 is 
set at 0.95. That is, if the estimated value of RH01 2 is greater than 0.95, the value of 0.95 
should be used. 

Unmatched Data, Time Averaged Method 

As defined above, in the unmatched data situation, a distinct crop yieid cannot be simuiated 
for each survey farm; however, spatiaiiy and varying weather and soii data are avaiiabie to 
run crop modei simuiations with representative management for the region. Thus, instead of 
simuiating a reiative yieid rjfor each farm, we use the avaiiabie data to simuiate a distribution 
of reiative yieids for farms in the study region. 

The basic idea behind the approach is to define statisticai distributions for the variabies of 
each system, and to use the avaiiabie data to estimate the parameters of these distributions. 
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The key missing piece of information Is th© correlation between systems, which most be 
approximated using some assumptions. Thus, in implementing the unmatched case, 
subjecting the modal to a sensitivity analysis of these assumptions is important. 

For the un~matched case we use the following additional definitions and assumptions; 


mean ofyni, h - 1,2 


Oh = standard deviation of y^y, h = 1 ,2 
+ ©r'- (0,1)== mean of fj 

as-pa + Oaiea. ea-(0,1) 

^2 ” Pg 0G (0p1 ) 

A5 ©r - iid(0,1 ) (r is independently distributed) 

A6 ©8 - lld(0,1) (as is Independently distrlbutsd) 

A7 ©G lld(0,1 ) (Ga Is Independently distributed) 

Btmp U1: same as step M A1 
Step U2: same as step M A2 

Simp U2: oalculate statistics for system 1 variables: |48 > 1 ^ 1 , cr^ , Or, oi 

Simp 1/4: Us© the statistics from Step U3 with the TOA-MD Statistics Calculator to calculate 
the system 2 statistics for the TOA-MD model. Note, this Includes the value for the between* 
system correlation (RH012). This estimate of the between-system correlation depends on 
the Independence assumptions A6, A6 and A7. Therefore, It Is wise to subject the model to 
sensitivity analysis around th© value of RH012 generated with this mode. 

Myltipla Activities 

For systems with multiple activities, we apply the above calculations to each system. In 
addition, we need to estimate the wlthln-system correlations between the returns to the 
activities. With matched data w© can calculate the within-system correlations for system 2 
the same way as for system 1 (Le., by using the survey data to estimate the with In-system 
average correlation between activities). For unmatched data, we typically assume that 
within-system correlations are the same for systems 1 and 2. 

For trend calculations, yield trends for major crops from global models are used as the 
starting point, with adjustments to regional conditions as appropriate. Minor crop trends 
should be defined by the team based on the major crop trends. Livestock trends should be 
based on global model trends for milk and maet as appropriate, adjusted to regional 
conditions. 
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Crop Model Simulations for Integrated Assessments: User's Guide 

K, ± Boote, C. Porter, C. Vflialobos, J. Hargreaves, J. Anile, R Valdivia, and 1 W. 

Jones 

Decembers, 2012 


Introduction 

This document describes AgMfP tools and procedures for using farm household survey data 
to create input files that are formatted for use in different crop models. It also describes the 
crop model output files that are needed for input to the TOA-MD economic model for 
integrated climate assessments. These files and procedures are provided for the "Matched 
Data'' case, which means that a distinct crop yield can be simulated for each surveyed ferm 
field, for each crop In the survey for which one or more crop models are available. In order to 
simulate each farm field that is in a survey, a minimum set of Input variables is needed by 
crop models. Generally, farm survey data do not include all variables needed by crop 
models to simulate crop growth and yield. Thus, in order to simulate yields for the fields, 
assumptions have to be made about a number of input variables that are missing. Some 
models have used their own built-in default values for missing inputs. However, this is not an 
acceptable practice. It is highly important that the assumptions about missing input values 
are transparent to users, consistent across all models used in the integrated assessments, 
and clearly documented. Furthermore, users need to have the ability to set missing values 
that best represent the farming systems that are being analyzed, and these will vary across 
regions. 

Data collected in farm surveys vary considerably from study to study. Here, we define the 
absolute minimum farm survey data necessary in order to approximately simulate each 
field's yield for the matched data case. We also define the minimum set of data needed to 
simulate crop growth and yield when the models are used to simulate water and N limited 
production. Because of the need to supplement farm field survey data with assumed values, 
two flies ere needed to provide all of the Information needed to create crop model-ready 
input files: 1) the farm survey data, and 2) a corresponding file that contains the assumed 
variable values that are needed to quantify all required Input variables that are not in the 
survey data. We describe these two files needed by AgMIP software to produce crop model- 
reedy input files and give an example of each. In addition, we describe a third file needed 
for setting up multi-year runs (baseline, climate scenarios, and RAPs). We also describe the 
softwara that does the translations and the model output file that Is needed by the TOA-MD 
model for the integrated assessment. 


Managing and Doeymenting Crop Model Inpyts 

Table A3.1 presents file types that can be used to import data to the AgMIP data translation 
tools. Templates of each file type are provided for users to enter data observed at their 
research or survey sites. These templates contain headers which correspond to variables in 
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the I CASA Master Variable list for which precise definitions and units are listed. These 
definitions and units are replicated in the templates as comments to help guide the user to 
the correct form of the input data. 

Raw survey data, measured at individual sites is stored in a Survey_DataJmportfile. 
Invariably, some required crop model inputs are not measured and must be assumed. Some 
crop models have internal assumptions that provide missing inputs but these are “hidden” 
from users, they vary across modeis, and they are not likely to be relevant for all regions 
where the modeis will be applied. In addition, some computer simulations make use of 
observed management, soil, and climate, but modify some of these factors to evaluate 
climate variability effects at a location, to assess impacts of future climate, and to evaluate 
hypothetical management options. The “Data Overlay for Multimodel Export”, or DOME, is a 
file type that is used by AgMiP toois to provide additional data used by each crop model to 
simulate crop growth and yield. Table A3.1 describes different types of DOME files currently 
implemented by AgMiP IT tools. 

One purpose of a DOME file is to provide model input information that is not contained in 
farm surveys, yield trials, or even field experiments. For exampie, data coiiected in regionai 
surveys usuaiiy do not have aii inputs needed for crop modei simuiations. The Fieid_Overiay 
fiie is used to fiii in the needed inputs that are missing so that aii of the modeis make use of 
the same regionai or site-specific assumptions. This concept ensures the integrity of 
observed vaiues, dearly documenting assumptions made for simulation anaiyses, and it 
ensures consistency across crop modeis for multi-model applications. 

A second type of DOME, the SeasonaLStrategy file, is used to provide information needed 
to create synthetic simuiation experiments for multiple seasons of weather data. These files 
provide information for controlling simulations for multiple years, for example, and/or 
management practices, cuitivars, and other inputs that define a particuiar scenario that is to 
be simuiated. These flies can provide information to set up baseline management and 
dimate simulations over multiple years, or they can be used to set up management 
adaptation options that may be derived from the Representative Agricultural Pathways 
(RAPs) analyses, in these cases, the soil, climate, and management regimens in 
Seasonal_Analysis DOME fiies would override existing recorded management and replace 
those data with the prescribed regimen. 

AgMiP data translation tools include a utility that wiii ailow crop modelers to match the 
survey data with chosen DOME files that describe missing inputs for management practices 
and soil conditions for a particular analysis. The Field_Overiay and SeasonaLStrategy 
DOME files are combined with archived survey data (Survey_Data_lmport files) and used by 
the data translators to produce model-ready crop model input files for multiple crop models. 


Data Requirements for Simulating Each Surveyed Field (Matched Case) 

Microsoft Excel files are used to collate the data described in Table A3.1. The Excel files are 
exported by users Into comma-delimited files (*.csv files). Software was developed to read 
and Interpret these *.csv data files containing the Survey_Data_lmport and Field_Overlay 
data. 
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The 8urvey__DataJmport file must be created from the field survey Information, with one line 
per farm-fleld that was sampled In the survey. Table A3.2 lists the data that are required In 
this file. Generally, household survey information includes crop yield, some management 
information, and economic data on a per farm-field basis, which may be in any format {e.g., 
Excel, ASCII, or print form). If the data are not In correct units or definitions (dry matter or 
ear versus grain), conversions are needed prior to entering data Into the 
Survey__DataJmport spreadsheet. Table A3. 3 lists an absolute minimum set of observations 
from field surveys; unless these data are available or can be estimated from the raw survey 
data, the crop models cannot be used to simulate matched field yields for the TOA-MD 
economic modal analyses. Typically, users can use the field LAT/LONG (preferred) or the 
village location for use In Interpolating climate data for the site and for selecting an 
approphata set of soil properties. 

An example Survey_DataJmport file is provided with this document that contains the field 
survey data along with soil and climate data for the fields in the format needed by AgMIP 
software. Each tab (worksheet) in the file must be saved as a separate comma-dellmlted 
(*.csv) file. 

Soil and climate data are typically not collected in farm surveys, so these data must be 
provided by users who are preparing the survey Excel data file for use by AgMIP software. 
Climate data may be provided in *.AgMIP format (the standard format used by the AgMIP 
climate team) as an alternative to comma-delimited (*.csv) format 

A second set of Excel files, the Field_Overlay DOME files, contain all assumptions about 
crop management and initial conditions that are rarely or never measured In the household 
surveys. There may be up to one Fleld_Overlay file per field if fields are highly different and 
need different assumptions about required inputs that were not measured. [These initial 
condi^ons and management assumptions are not trivial and can make a large difference in 
simulated yield. See later discussion describing how Agronomists and experts In the region 
need to be consulted in order to create this ff/e.] Table A3.4 provides a list of the currently- 
defined minimum management and initial soil condition information needed by crop models 
(that are likely not provided in the household survey). These data are entered into the 
Field__Overlay file for use by AgMIP software to fill data not available in the farm survey data. 
The overlay files also document explicit assumptions made and used consistently across all 
crop models for the simulations. The Field_Over1ay file along with the corresponding 
Survey_DataJmport Excel file provide all of the Input data currently needed to run crop 
models for the matched field survey of observed yields. Later, we will describe an 
additional SeasonaLStrat@gy.xlsx type of DOME file that will be additionally needed to run 
multiple year baseline and multiple year climate scenarios as well as RAPs. 


Software for Froduclng Crop Model input Flies 

QuadUf Is a desktop utility that reads survey and DOME data and translates to model-ready 
format. This software reads all field information contained in the matched 
Survey„DataJmport file and the associated Field„0v@r1ay files and creates DSSAT and 
APSIM model Input files. Translators for other models are being Integrated Into QuadUl as 
they are developed by the various crop modeling teams. 
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Crop Model Outputs for Use by the TOA-MD Model 

Outputs from the crop models are then arranged into the AgMIP Crop Model Output file 
(ACMO.csv) for use as input to the TOA-MD model. ACMOUl is a desktop utility that will 
generate the ACMO harmonized crop modeling output file from the various models. This file 
contains metadata which fully describes the crop modei simulation linking the model outputs 
to the ACE and DOME data. 


Procedures for Creating Crop Model-Ready Input Flies for Survey Fields 
Step 1. Gather, assemble and enter data (survey and expert) 

• Download data translation tools from http://tools.agmip.org/ 

o Quad U I - desktop application for data translation 
o ADA - converts from Excel to csv format for Import to QuadUl 
o ACMO_U I - converts model output to ACMO format 
o Sample spreadsheet templates for survey data and DOME data ICASA 
Variables List- list of variables to extend the survey data template, If needed 
(http://tinyurl.com/ICASA-MVL) 

• Using one of the sunrey data templates, enter the appropriate following data by 
either: 1 ) cut-and-paste, or 2) direct entry. The entry is on a ‘'per-farm-field” basis, 
one line per site. If you have additional field-measured variables that are not 
Included in the template, it is possible to extend the file to include your variables. The 
ICASA Variables list shows ail of the possible variables that can be used to define 
site data. Additional columns can be added to the survey data Import template for 
those data. 

• If some data are missing, one or more Field Overlay templates should be used to 
FILL in the missing data (examples are dates of N fertilization or manure application). 
There can be multiple field overlays, if soils and soil initial conditions vary across 
farms. The Field_Overiay ID is specified per site in the survey data import file. 
Required minimum data include: 

o Field/Farm Name 

o Latitude and longitude of farm (or give nearest village name) 
o Weather station identifier (connects to climate files) 
o Soil identifier (name connecting to soil files) 

o Field.Overlay identifier (name connecting to all the unknown management 
assumption information for a given Field) 
o Crop (maize, wheat, etc.) 
o Sowing date 

o Plant population (plants per m2) 

o N fertilization (amount, kg N/ha and date of application) 

o Manure or organic matter applied (amount, kg/ha dry matter, and date) 

o Irrigation (yes or no) 

o Harvest date (desired, but not crucial) 

o Harvested yield (kg/ha dry matter) 

o Harvested byproduct (non-grain) removed by farmer (desired, not crucial) 

• Visit with Soil Scientist experts from the region: Find the appropriate soil tor each 
farm (linking to latitude-longitude or village information), and enter the soils 
information by soil layer in the soil tab in the Survey_Data_lmport file. The soil name 
is also listed in the field section of the Survey_DataJmport fiie. 
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• There will be one or more Field_Overiay sheet, in which you will enter expert 
knowledge of Agronomists and Soil Scientists to define all the missing information 
that is not available in the household survey data, defining probable initial conditions 
related to initial soil water, initial soil mineral N (NOS & NH4), soil organic carbon, 
prior crop residue, prior root residue, shape of initial mineral N, shape of SOC, shape 
of inert SOC, and shape of probable rooting profile. Do not attempt to simulate 
without a field overlay file, as data will inevitably be missing and model defaults 
incomect. 

o Field_Overlay files will tend to be soil-related for initial conditions for water, 
mineral N, SOC, SOM, residue, rooting shape where soils are different, 
o Field_Overiay files may also be sowing-related (plant population) or fertility 
management-related (fertiiizer/manure). 

Step 2. Save Survey.DataJmport and Fleld_Overiay Data to cev format 

• Using the ADA utility, save Survey_Data_lmport sheets in comma delimited (csv) 
format, one for field, one for soil, and one for each climate file, zipped into a single 
archive. Caution; Do not open the *.csv flies again with Excel, as they ARE NOT 
true spreadsheets and do not correctly convert back into Excel files; the date format 
can revert to a machine-dependent format. 

• Using the ADA utility, save the Fieid_Overiay spreadsheets in comma delimited (csv) 
format, zipped into a single archive. 

Step 3. Translate data flies to model-ready formats 

• Run QuadUl by double-clicking on the QuadUl.bat file. Respond to the on-«creen 
requests for location of zipped Survey csv files and zipped Field_Overiay csv hies, as 
well as the placement for the output crop model files. If you are not successful, view 
the QuadUl log report in the QuadUl folder. 

• Your ending point will be flies for running crop models, i.e.. Files X, A, SOIL.SOL, 
*.CUL, *.WTH for DSSAT, and similar files for APSIM or other crop models. In the 
case of DSSAT or APSIM, simulations can be run by double-clicking the DOS batch 
file that was created with the translations. 

Step 4. Check and correct missing/invalid model input data and run 

simulations 

• Run the crop model. With APSIM, load the simulation and view the log. With 
DSSAT, look at the Error.OUT and the Warning.OUT files. These files will tell you if 
the climate file or cultivar were not found, or if some variables such as sowing date or 
plant population were missing. With APSIM, after the issues in the LOG are dealt 
with, run the simulation. APSIM produces summary files (*.sum) which are a log of 
significant events and wamings/fatal errors. The summary files need to be checked 
for errors which may need to be corrected, otherwise the error in simulated yields 
may be significant. If there are failures, go back to the Survey_Data_lmport and 
Field_Overlay DOME files. Common errors include: 

o If plant population (or other) was not in the Survey_Data_lmport file, and is 
not found, then you did not connect the Fieid_Overiay file correctly, 
o Field.Overlay name was not entered in the survey template exactly as in the 
Field_Overlay file. In this case, no Fieid_Overiay data were found. 

• Evaluate the outputs. In DSSAT, look at the Evaluate. Out file which will list both the 
simulated and the observed yield. In APSIM, there is a single line output for each 
simulation. The APSIM-simuiated yield values will need to be aggregated 
(assembled) into one file. The observed yields are in the Survey_Data_lmport file 
and will need to be matched per field. 
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Step 5. Create AgMIP Crop Model Output (ACMO) File for use by Economic 
Team Members 

The ACMO file is partially created by QuadUl at translation time in the form of the 
ACMO_meta.dat file which contains metadata in one line per field so that all of the 
information used to simulate results for the fields is documented in a way that users could 
reproduce the results. Running ACMOUl, a desktop utility, will complete the ACMO file with 
the selected crop model simulated outputs. 

Note that the ACMO files contain raw simulated results for each field, not aggregated or 
adjusted in any way. This will ensure integrity of both inputs and model outputs. Table A3. 5 
lists all of the variables that ACMO contains along with information on variables created by 
QuadUl and those that must be added by crop modelers. 


Create Crop Model-Ready Input Files for Simulating Multi-Year Baseline, 
Climate, and RAPs Scenarios (Using Strategy_Analysis files) 

A Seasonal_Strategy type of DOME file will be created to assist multi-year simulations for 
baseline and climate scenarios, both with and without RAPs. The starting point will be the 
Survey_Data_lmport and the Field_Overlay files that were already created for the surveyed 
fields. In this case, the Survey_Data_lmport file, in addition to having a Field_Overiay ID per 
field, will also have a Seasonal_Strategy ID (possibly Just one for all farms in the survey). 
Examples of what is in that file include: 

* For Baseline Multi-Year: auto-sowing rules 

* For Future Climate Scenarios: auto-sowing rules, plus link to new weather station IDs 

* Translating RAPS into management using the Seasonal Strategy (RAPs can led to 
improved crop and soil management practices including improved genetic 
technology). Specifics include: 

o Auto-sowing, possibly modified for eariier/shorter sowing window because of 
better machinery 
o Weather station ID 
o changed plant population, 
o improved or alternative crop cuitivar, 
o changed N fertilization, 

o increased prior root and surface residue (because of better fertilization- 
population-cultivar) 

o other adaptation strategies, as needed 

To run a Seasonal Strategy, repeat ail of the steps for baseline analysis, using the 
Survey_Data_lmport and Fleld_Overiay files, but now the Seasonal_Strategy DOME files 
are also prepared using the spreadsheet templates. Each of the three sets of files 
(Survey_Data_lmport, Field_Overlay, and Seasonal_Strategy) should be compressed into 
separate zip files for import to QuadUl. 


Notes on Use of Field_Overlay Files 

• Function and Purpose of multiple Fleld_Overiay files 
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o Fill in data that crop models need that are almost never available in 

household survey, such as Initial soil water, initial soil nitrate and ammonium, 
soil organic carbon pools (S0M3 for DSSAT-CENTURY, and inert SOC for 
APSIM), and rooting depth (see Table A3.4). The shape of these listed 
variables by soil depth is also generally missing, 
o Fill in needed data missing from household survey, such as root residue from 
prior crop, surface residue from prior crop, sowing date, sowing depth, plant 
population, amounts and dates of fertilizer or manure applied, 
o Link to cuitivar ID and model specific cuitivar ID 

o It can be used to set automatic sowing rules for each field in the survey, if 
planting dates were not recorded. 

• Where to get Field_Overlay information? First, DO NOT use crop model defaults, as 
the model defaults are wrong and differ among crop models. Often defaults use zero 
or unity values when not appropriate and these are not region-specific. Secondly, 
this must be done in close collaboration with local agronomists and soil scientists. 

o Agronomists and soil scientists in the region who know production practices 
for the crop and region in question. Although they may not give specific 
values for the needed inputs, they will likely provide very useful ranges of 
likely missing input information. 

o Soil survey information (linking to latitude-longitude coordinates for fieid). 
o Country-wide statistics (amount of N fertilization per hectare), but this is not 
region- or crop-specific. 

o Pre-simuiations with crop models with correct soil organic carbon and SOM3 
(or inert SOC) pools, for setting S0M3 and inert SOC to give the low non- 
fertilized non-legume yields for the region (requires knowledge of unfertilized 
yield for region). Take the mineral nitrate and ammonium from the values 
simulated at the end of the ‘'prior*' season, 
o Make sure that the assumed values that you use in the Field.Overiay file are 
consistent with ail of the expert knowledge and soil survey information, and 
document how these values were developed. 

• Principles for use of Field_0vei1ay files: 

o First obtain knowledge from agronomists, soil scientists, and soil surveys, 
o Do not use model defaults for missing information 
o Then use QUADUl with Survey_Data_lmport and multiple Field_Overlay 
files, to create model-ready files for simulation, 
o Simulate farmer fields (n = 50 to 150) 


Summary of Simulation Runs Needed for Integrated Assessments 

Crop modeling teams need make several separate sets of simulation runs and prepare 
several ACMO files for the integrated assessments. The ACMO will be provided to the 
Economic modelers for use in the TOA-MD analyses. Specifically, the following set of runs 
will need to be made, each with its corresponding ACMO file: 

1 . Matched simulations, with observed inputs and raw crop model results (not bias- 
corrected). This set of runs will require the Survey_Data_import fieid survey fiie aiong 
with the Fieid_Overlay fiie. 

2. Simuiation Set#1. Current system simulation results, multiple years (e.g., 30 years), 
which means current climate and current management conditions. This set of runs 
will require the same two files above in addition to a Seasonal_Strategy fiie that wiii 
set up the multi-year simulations. 

3. Simulation Set #2. Climate change simulated results, multiple years (e.g., 30) using 
current management with future climate conditions. This aiiows paired ciimate 
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change impact assessments. This set of mm will also require the same two files 
above in addition to a SeasonaLStrategy file that will set up the moltl-year 
simulations, this time using a future climate scenario. 

4. Simulation Set #3. Climate change simulated results, multiple years (e.g., 30) using 
adaption management with future climate conditions. This allows paired climate 
change impact assessments. This set of runs will also require the same two files 
above in addition to a Seasonal^Strategy file that will set up the multi-year 
simulations, this time using a future climate scenario. Adaptation scenarios Include 
improved cultivars, different fertilizetlon, and altered sowing dates, consisterit with 
RAPS. 

5. Archive model simulations (Inputs, management, outputs, soli, climate, cultivar 
coefficients, simulated outputs) by placing them in the ACE, DOME and ACMO 
databases. 

B. Document simulations with explanatory text and appropriate tables and figures 
showing the yield distributions and analyses of Interannual and spatial variations. 
Create maps and summary statistics e.g., spatial distribution of climate, soils, 
management, and yields illustrated in GIS mapping methods. 


Guldelfnes for Analysis of Crop Model Simulated Outputs for Mitdiecf Fields 

Crop modelers should analyze model outputs prior to use of the data in the regional 

economic analysis. This Is very Important to ensure quality control of the process and that 
crop modelers are able to understand the variability In results. It is also important that crop 
modelers will be able to conclude that simulated yields are reasonable representations of 
water and nitrogen-limited yields, recognizing that other factors, such as other soli nutrients 
and peats, are likely to contribute to actual yields in a region and that these factors could 
vary considerably over space and time. We have provided suggestions for analyzing crop 
model outputs, Including computation of means, distribution of observed and simulated 
yields, computation of mean bias between observed and simulated yields, and analysis of 
Dutliars. 

• Evaluate Simulated and Observed Yields for Mean, Bias, and Distribution 

• Place simulated yield and observed yields into a spreadsheet, computing means and 
standard deviation. Compute bias of the mean observed yield divided by mean 
simulated yield. We do not recommend computing bias of Individual fields If there 
are any zero simulated yield values, as that will give error, 

« Rank the observed yields and simulated yields from high to low and compute 
cumulative probability distributions of observed and simulated yields. 

« Attempt to Identify outliers and reasons for high mean bias as well as large 
differences between cumulative distributions of simuiated and observed yields. 
These analyses may help crop modelers critically evaluate some of the input 
assumptions In the Fleld_Overlay ffle, for example, relative to the Information from 
regional agronomists and other sources that were used to set the values, if there is a 
large bias, it would be good to review the inputs and results with agronomists. We do 
not recommend any type of calibration for reducing the bias; this is Intended to 
improve the reliability of the process and results. These analyses may be useful in 
reporting and in publishing crop model results; only the final raw field-by-field 
simulated yields will be used in the ACMO file. Some Ideas to consider as you 
analyze results are: 

o If bias (observed over simulated) is dramatically different from 1 .00 (for 
example 0.6 or 1 .5), there may be problems In Fleld_Overlay assumptions. 
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Bias Is driven by the mean simulated and observed yields. For example, a 
high bias of 1 .5 or more could Indicate that soil N availability (S0M3, Initial 
nitrate, initial ammonluiti) or soil water availability (initial or capacity) is not 
high enough. A low bias of 0.5 (model simulates too high) could Indicate too 
much soil N availability or too much water availability, 
o The full range of the cumulative distribution Is driven not just by the 
management and climate, but also by the extent of range of Initial nitrate, 
ammonium, SOC, SOM, DUL-LL, and initial soil water found across all the 
farms. If that range of Inputs is small (because of inadequate Fleld_Over!ay 
entry), then the simulated distribution of yields could be Insuffident 
o Strong left tails In simulated distribution (or observed) are indicators of crop 
failures (zero and very low yields). If left tails Is too strong In simulated, then 
you may need to Increase initial soil water content to reduce the Instance of 
simulated germination failures, or Increase rooting depth or DUL-LL to 
minimize crop falluras during reproductive growth, 
o Strong right tails In simulated or observed distributions are indicator of high 
yields. If simulated right tails are too strong (or too little) where the water and 
N stresses are minimum, one can make the case that genetic yield potential 
of the Gultivar is too high (or too low). 

o These “indicator problems are given, not for the purpose of re-callbratlng the 
crop models to fit the distribution, but for the purpose of highlighting the need 
for obtaining correct Fleld__Over1ay Information in the first place. 
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Table A3.1. Description of data Hies used by AgMIP IT tools to create multiple crop model input files. 


T]jfp@ ©f 
Fife 

Name 

Description 

Fife Tf|!ie(s) 

Raw data 

Survey„Data„lmport 

A Hie used to provide observed 
Held survey date for use in crsatlng 
multiple model inputs 

Excel Spreadsheet, one line per 
Held, which is exported to a comma- 
delimited (*.csv) file for import 

DOME 

FsBld__Over1ay 

Used to provide missing inputs 
needed by models that are not In 
the obsarvad Held survey data 

Excel Spreadsheet, which is 
exported to a comma-^lelimrted 
(•.CSV) file for Import. File name Is 
used to link this file to each field In 
the Sunroy_DafaJmport file 

DOME 

Seasonal_Stratagy 

Used to sat conditions for multi- 
year mode! simuleHon of 
attamalfva managament pradJcas, 
soils, with muidple historical or 
future years of climate data. 

Mi 

DOME 

Rotatlon_Stratagy 

Ussd to sat conditions for multi- 
year modei simuiadon of crop 
rotattons, having Just one set of 
initial conditions at year 1 

[not yet Impismentad] 

ACMO 

AgMIP Crop Modal 
Outputfila 

These files contain a summary of 
crop modal output data and 
document all of the inputs used by 
crop modsts to simuiate those 
outputs. These files are used by 
TOA-MD economic model teams 
as Input to their analyses. It also 
includes all metadata describing 
the field soil, dimate scenario, and 
management such that simulation 
can be repeated. 
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Tabi® List cf variabSes in the househatd survey FIELD dalH needed to run crop models. These data are in 
the Survey_Oate__impDrt.xJsx EXCEL file. No^ that some of these data may not have been collected in the 
survey but are provided later by those who are preparing the data fbr transSation by AgMSP aoftwans tooBs into 
model-spedllc input fiies needed to run each crop mode!. 


Data Tfpe 

Units 

Variable INiama 



EXNAME 








dec. degrees 

FL LAT 

Longitude 

dec. dsgraes 

FL LONG 

Weather station identifier to link to site 
information 


WST ID 



SOIL ID 

Piandng date 


PDATE 

Crop ID (see list of codes above) 


11!^^ 

Total seasonal N applied 


FEN TOT 

Manura/Onganlc matter applied 

kg[DM]/ha 




lllllll^^ 

Harvest yield (dry wt) 

kg[dryl/ha 


By-product removed at harvest as dry wt 

IIIIh 

BWAH 

Indicates whether the Held has been 
irnpated 

YorN 

IRRIG 
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Table A3.3. List of observations that are considered absolute minimum in order to simulate each fieid in the 
survey using management, climate, and soil information for the field, the “matched data* case. 


1 . Village name for climate data interpolation, which will almost always have to be done). 

2. Farm/field name (This plus village name provides the unique field name for the simulation and 
location is used to identify a suitable soil to obtain soil inputs needed for the model. 

3. Crop species 

4. Sowing date (yyyy-mm-dd). 

5. Mineral N fertilizer amount used (elemental N applied per ha, or at least categories that can 
be consistently interpreted to estimate amounts, such as none, low, medium, and high) 

6. Farmyard manure or organic matter applied, if not given, we would assume that it is zero. 

7. Whether irrigated or not. Probably, this is rare in most of our AgMIP SSA and SA projects, 
except for rice. Also could include total irrigation for the season in mm (IRR_TOT). 

8. Grain yield (dry weight per ha, or otherwise indicate basis and units for yield in survey data. 


Table A3w4. A list of the minimum management and initial soil condition infbnnation needed by crop models 
that is probably not provided by household yield survey. **indicates data hopefully provided from survey. 


1 . Cultivar ID (link to modal-specific cuitivar) 

2. Sowing date (yyyy-mm-dd)** 

3. Sowing depth (cm), 

4. Plant population (plants/m2) ** 

5. Mineral N fertilizer amount used (kg elemental N applied per ha), dates of application (yyyy- 
mm-dd or days after sowing), percentages for split amounts? ** 

6. Farmyard manure or organic matter applied (kg DM per ha) and dates of application (yyyy- 
mm-dd or days after sowing}.** 

7. Whether irrigated or not.** 

8. Root residue from prior crop (kg/ha) 

9. Surface residue from prior crop (kgAia) 

10. Maximum rooting depth (and shape relative to 1.0 in topsoil) 

11. Initial soil water (zero to 100% of available) (for each layer, or shape?) 

12. Initial soil nitrate and ammonium (for each layer or shape in profile if kg N/ha total?) 

13. Soil organic carbon pools (fraction SOM3 for DSSAT-CENTURY, or fraction inert SOC for 

APSIM), by each layer, or shape. 
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Table A3.S. List of variables contained in the ACMO file for documenting crop modal runs 
and for use by economic modelers in the TOA-MD analyses. Also the table shows which 
variables are created automatically by the AgMlP IT Tool, QuadU! and which must ba added 
by crop modolers. 


Variable Name 

Deflniti 0 n 


Metadata or Crop M&M Input symmary data (provldad by QyadUf) 

EID 

Experiment ID 


SUITEJD 

Suite IdentHication, for linking groups of sites or 
axparimants 


RUN# 

Simulation order 


FIELDjDVERLjW 

Name of field overlay(8) 


S^SOHK^STmfEGY 

Name of seasonal strategy(les) 


EXNAME 

Name of experiment, field test or survey 


TRT_NAME 



CLIMjb 







1 continuous, multi-year simulation, =0 for single year 


CC 


WSTA„ID 

1 Wiiatb^iiNai|tlon ID 





Soli ID 



Site Latitude 

decimal degrees 




Crop model-speciffo culiivar ID 
Cultivar name 
Start of simulation date 
Planting date 

Observed harvested yield, dry weight 




yyyy-mm~dd 

yyyy-mm-dd 

kg/ha 



ToIhI number of fertilizer applications 


Total N applied 
Total P applied 
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FEK^TOT 

Total K applied 

kg[K]/ha 

OM_TOT 

Manure and applied oganio matter 

j 

kg/ha 

TL# 

Total number of tillage applications 


tllMPJajd 

tillage type (hand, animal or mechanized) 


Crop model slnriyiation oytpyt data (provided hy the orop modeler) 

CROP_MODEL 

Short name of crop model used for simulations 
(e.g., DSSAT, APSIM, Aquacrop, STICS, etc.) 


MODEL„VER 

Model name and version number of the crop model 
used to generate simulated outputs; 


HWAH__S 

Simulated harvest yield, dry matter 

kg/ha 

CWAH„S 

Simulated above-ground biomass at harvest, dry 

kg/ha 

|gg|gg||M 

Blilgited anthesis date 

yyyy-mm-dd 

MDAT_S 

Slmylated matuitly date 

yyyy-mm-cid 

HADAt_S 

Simulated harvest date 

yyyy-mm-dd 

LA!>eS 

Simulated leaf area Index, maximum 

m2/m2 

PRCP„S 

Total precIpItaHon from planting to harvest 

mm 

ETCF^_S 

Simulated evapotnanspiration, planting to harvest 

mm 

NUCM„S 

SImulatad N uptake during season 

kg/ha 

NLCM„S 

Simulated N leached up to harvest maturity 

kg/ha 
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